PinnedPublished inEatCodePlayHarnessing the Power of Hugging Face and AWS for Scalable Image ClassificationAt RealScout, we recently embarked on a journey to revamp our image classification solution from the ground up. In this article, we share…3d ago3d ago
PinnedPublished inEatCodePlayA Simple DAG to Quickly Purge Old Airflow LogsEarlier on, we had little automation around the maintenance of our Airflow cluster. Those of you familiar with Airflow may be aware of the…Aug 16, 20213Aug 16, 20213
PinnedPublished inEatCodePlayUpgrading to Airflow 2.0: Massive Performance Wins and Lessons LearnedAt RealScout, we use Apache Airflow to orchestrate our crucial workflows such as data ingestions, health checks, and reconciliation…Apr 30, 2021Apr 30, 2021
PinnedPublished inEatCodePlayZero-Downtime ECS Cluster UpgradesAs part of the DataOps team at RealScout, I recently worked on a project to tackle infrastructure issues that plagued us for some time. We…Dec 18, 2020Dec 18, 2020