#data-science

36 posts · All tags

  1. LLM-assisted HDB Resale App Rewrite

    · 4 min read

    After 20 minutes of spec-driven project initialisation + 20 hours of LLM-assisted manual review, I finally managed to fully rewrite and redeploy my web app on HDB resale pricing…

  2. Open Weight CV GenAI Models - FLUX.2

    · 1 min read

    On the front of generative AI for computer vision, there have been a lot of discussions on the more popular models like Nano Banana 2.

  3. Vibe Coding and Vibe Graphic Design

    · 1 min read

    I had always watched the vibe coding debates from the side line.

  4. Data Science Dashboard/Web App Alternatives

    · 1 min read

    Whenever I need to build a dashboard, I have always relied on a mix of Python-based libraries (e.g. Dash, Streamlit) and commercial software (e.g. Tableau, PowerBI).

  5. Career Quoridor

    · 1 min read

    Managing your career is like playing a game of Quoridor.

  6. Some Closing Thoughts on Kubernetes

    · 2 min read

    Sharing the services and associated configurations I used to set up the Kubernetes backend powering my personal stack. In case the design is useful to others.

  7. Onto Kubernetes - Part 5

    · 1 min read

    I really liked the Bitnami’s Helm charts and Docker images repositories, at least until they decided to make their images paid access only.

  8. Onto Kubernetes - Part 4

    · 2 min read

    With the Prometheus-Loki-Grafana stack being deployed, the observability stack has been fully deployed on the Kubernetes cluster. Operational metrics gathered by Prometheus and…

  9. Onto Kubernetes - Part 3

    · 4 min read

    I am still working on the Kubernetes stack behind my personal website whenever I have some free time.

  10. Owning your career as a data scientist

    · 1 min read

    It is the time of the year again when people start to reflect on the past year and plan for the year ahead.

  11. Data Science - Profit Centre vs Cost Centre

    · 2 min read

    Have you ever wondered how can we justify the business values created by data science? Is there any difference between a profit centre setup (i.e. client/stakeholder funded) for…

  12. Brief Review on GitHub Copilot

    · 2 min read

    Time really does fly. It is now almost the end of 2024.

  13. Onto Kubernetes - Part 2

    · 2 min read

    About 2 months ago, I started migrating my entire personal stack onto Kubernetes from regular virtual servers.

  14. Technical Debt vs. Mortgage: A Data Science Homeowner’s Guide

    · 1 min read

    (I used chatGPT to help me make the written content more "engaging" and "LinkedIn-like", so keeping the 2 versions below for comparison purpose.)

  15. Onto Kubernetes

    · 1 min read

    I have always been told that using Kubernetes is too complex and overkill for most purposes.

  16. 3 Micro Learnings Over the Weekend

    · 1 min read

    3 micro learnings over this weekend :

  17. New additions to family - Traefik and Airflow

    · 1 min read

    Added Traefik and Airflow to the family of services behind my personal websites.

  18. FIRE planner

    · 1 min read

    Built a new dashboard to help you plan financially for your potential FIRE (financial independence retire early).

  19. Excel + Office Scripts

    · 1 min read

    If you have worked with Excel automation in the past, you may have painful memories working with complex Excel functions or VBA codes.

  20. Infrastructure and framework behind my personal websites

    · 1 min read

    I decided to set up my own website at the end of 2020.

  21. Makefile

    · 1 min read

    A small titbit to share today, the Makefile.

  22. Rocket League reinforcement learning-trained bot

    · 1 min read

    As a passionate gamer, I have been reading about the Rocket League Nexto cheat situation with keen interest…

  23. Timeline of LLM

    · 1 min read

    "Classic quant signals might work, but you can’t explain them; ChatGPT might not work, but it can explain itself.

  24. Data science solutions - Build vs buy

    · 1 min read

    Many data scientists are working in companies with less advanced technology infrastructure.

  25. Being a data scientist in consulting

    · 1 min read

    A very accurate and vivid description of being a data scientist in a consulting context.

  26. Delegating to chatGPT & Stable Difussion

    · 2 min read

    This week, I am jumping on the bandwagon by delegating the task of creating my LinkedIn post to chatGPT (for text) and Stable Diffusion (for image) with the following prompts.

  27. Soft skill - +1 mindset

    · 1 min read

    Recently I reflected on my professional career on things that I have done differently earlier on in my career versus now.

  28. Things they didn’t teach you in software engineering

    · 1 min read

    Whenever you feel disillusioned about the mismatch in promises between what you were taught in university/bootcamp versus what you actually worked on in a job.

  29. State of DS Survey by Anaconda - Skill Gaps

    · 1 min read

    According to the State of Data Science survey done by Anaconda, the top 5 most important skill gaps in data science are:

  30. Illustrated stable diffusion from Jay Alammar

    · 1 min read

    If you are interested in knowing how Stable Diffusion generates amazing AI arts, but are put off by the steep technical details,

  31. Short review of Designing Machine Learning System

    · 1 min read

    I have finally finished “Designing Machine Learning Systems” after a few weekends of focus reading. It is one of the rare technical books that I finished in its entirety, and I…

  32. Automatic speech recognition - Whisper OpenAI

    · 1 min read

    Whisper is a recently released transformer-based automatic speech recognition (ASR) model from OpenAI.

  33. Data versioning

    · 1 min read

    “Data versioning is like flossing. Everyone agrees it’s a good thing to do, but few do it.” Chip Huyen, Designing Machine Learning Systems

  34. Concept drift vs data drift vs covariate drift

    · 1 min read

    Do you always get confused among concept drift vs data drift vs covariate drift like me?

  35. MLU-Explain : Visual explanation of ML concepts

    · 1 min read

    A very cool website from Amazon that explains various machine learning concepts using interactive and visual essays.

  36. ML system design - problem definition & consulting

    · 2 min read

    I recently started reading the excellent book called Designing Machine Learning Systems by Chip Huyen.