#data-science
LLM-assisted HDB Resale App Rewrite
After 20 minutes of spec-driven project initialisation + 20 hours of LLM-assisted manual review, I finally managed to fully rewrite and redeploy my web app on HDB resale pricing…
Open Weight CV GenAI Models - FLUX.2
On the front of generative AI for computer vision, there have been a lot of discussions on the more popular models like Nano Banana 2.
Vibe Coding and Vibe Graphic Design
I had always watched the vibe coding debates from the side line.
Data Science Dashboard/Web App Alternatives
Whenever I need to build a dashboard, I have always relied on a mix of Python-based libraries (e.g. Dash, Streamlit) and commercial software (e.g. Tableau, PowerBI).
Career Quoridor
Managing your career is like playing a game of Quoridor.
Some Closing Thoughts on Kubernetes
Sharing the services and associated configurations I used to set up the Kubernetes backend powering my personal stack. In case the design is useful to others.
Onto Kubernetes - Part 5
I really liked the Bitnami’s Helm charts and Docker images repositories, at least until they decided to make their images paid access only.
Onto Kubernetes - Part 4
With the Prometheus-Loki-Grafana stack being deployed, the observability stack has been fully deployed on the Kubernetes cluster. Operational metrics gathered by Prometheus and…
Onto Kubernetes - Part 3
I am still working on the Kubernetes stack behind my personal website whenever I have some free time.
Owning your career as a data scientist
It is the time of the year again when people start to reflect on the past year and plan for the year ahead.
Data Science - Profit Centre vs Cost Centre
Have you ever wondered how can we justify the business values created by data science? Is there any difference between a profit centre setup (i.e. client/stakeholder funded) for…
Brief Review on GitHub Copilot
Time really does fly. It is now almost the end of 2024.
Onto Kubernetes - Part 2
About 2 months ago, I started migrating my entire personal stack onto Kubernetes from regular virtual servers.
Technical Debt vs. Mortgage: A Data Science Homeowner’s Guide
(I used chatGPT to help me make the written content more "engaging" and "LinkedIn-like", so keeping the 2 versions below for comparison purpose.)
Onto Kubernetes
I have always been told that using Kubernetes is too complex and overkill for most purposes.
3 Micro Learnings Over the Weekend
3 micro learnings over this weekend :
New additions to family - Traefik and Airflow
Added Traefik and Airflow to the family of services behind my personal websites.
FIRE planner
Built a new dashboard to help you plan financially for your potential FIRE (financial independence retire early).
Excel + Office Scripts
If you have worked with Excel automation in the past, you may have painful memories working with complex Excel functions or VBA codes.
Infrastructure and framework behind my personal websites
I decided to set up my own website at the end of 2020.
Makefile
A small titbit to share today, the Makefile.
Rocket League reinforcement learning-trained bot
As a passionate gamer, I have been reading about the Rocket League Nexto cheat situation with keen interest…
Timeline of LLM
"Classic quant signals might work, but you can’t explain them; ChatGPT might not work, but it can explain itself.
Data science solutions - Build vs buy
Many data scientists are working in companies with less advanced technology infrastructure.
Being a data scientist in consulting
A very accurate and vivid description of being a data scientist in a consulting context.
Delegating to chatGPT & Stable Difussion
This week, I am jumping on the bandwagon by delegating the task of creating my LinkedIn post to chatGPT (for text) and Stable Diffusion (for image) with the following prompts.
Soft skill - +1 mindset
Recently I reflected on my professional career on things that I have done differently earlier on in my career versus now.
Things they didn’t teach you in software engineering
Whenever you feel disillusioned about the mismatch in promises between what you were taught in university/bootcamp versus what you actually worked on in a job.
State of DS Survey by Anaconda - Skill Gaps
According to the State of Data Science survey done by Anaconda, the top 5 most important skill gaps in data science are:
Illustrated stable diffusion from Jay Alammar
If you are interested in knowing how Stable Diffusion generates amazing AI arts, but are put off by the steep technical details,
Short review of Designing Machine Learning System
I have finally finished “Designing Machine Learning Systems” after a few weekends of focus reading. It is one of the rare technical books that I finished in its entirety, and I…
Automatic speech recognition - Whisper OpenAI
Whisper is a recently released transformer-based automatic speech recognition (ASR) model from OpenAI.
Data versioning
“Data versioning is like flossing. Everyone agrees it’s a good thing to do, but few do it.” Chip Huyen, Designing Machine Learning Systems
Concept drift vs data drift vs covariate drift
Do you always get confused among concept drift vs data drift vs covariate drift like me?
MLU-Explain : Visual explanation of ML concepts
A very cool website from Amazon that explains various machine learning concepts using interactive and visual essays.
ML system design - problem definition & consulting
I recently started reading the excellent book called Designing Machine Learning Systems by Chip Huyen.