Data Engineering

concepts · 9 notes linked

Related: Data Analytics · Data Democratization · Distributed Computing · Data Science · Data Warehousing · Hadoop · Pandas · Jeroen Janssens

Notes

• 21st-Century Analytics: New Technologies and New Rules — Higher-education analytics modernization arguing against 30-year-old Kimball data warehouse mental models
• 7 Command-Line Tools for Data Science | Jeroen Janssens — Seven Unix command-line tools for OSEMN data science workflow
• Adam Drake — Command Line Tools 235x Faster Than Hadoop — Unix command-line tools outperform Hadoop cluster for data processing tasks
• Adam Drake — Command-line Tools can be 235x Faster than your Hadoop Cluster — Shell pipelines outperform Hadoop by 235x on single-machine data tasks
• Business Technology Trends and Predictions 2019 — Six new rules for 21st-century analytics enabled by streaming and cloud technologies
• Data Movement in Netflix Studio via Data Mesh — Netflix Studio CDC streaming pipelines via configuration-driven Data Mesh
• Don't use Hadoop - your data isn't that big — When Hadoop is overkill versus simpler data tools
• GitHub - Factual/drake: Data workflow tool, like a "Make for data — GNU Make-inspired data workflow tool with dependency resolution
• The Changing Data Science And Data Engineering Tooling Environment — Distinguishing data scientist and data engineer roles, skills, and org structure