Data-Shuffler: Bringing Order to The Galaxy (of Data Process) - Luke Hospadaruk
Data-Shuffler is an ETL system implemented in Clojure on top of Apache Spark whose primary goals are testability, reliability, and collaboration. Clojure has allowed us to construct a robust ETL foundation that enables the entire organization to participate in a performant, well tested ETL system to get the datasets and insight they need, as well as contribute to organization-wide data and reporting initiatives. Using clojure.spec in particular has allowed us to focus on the model and the underlying features, while giving us the flexibility to compose and manipulate already-implemented functionality to meet unanticipated needs quickly as they arise.
Видео Data-Shuffler: Bringing Order to The Galaxy (of Data Process) - Luke Hospadaruk канала ClojureTV
Видео Data-Shuffler: Bringing Order to The Galaxy (of Data Process) - Luke Hospadaruk канала ClojureTV
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Every Clojure Talk Ever - Alex Engelberg and Derek SlagerFaster Delivery with Pedestal and Vase - Paul deGrandisWhat Are All These Class Files Even About? And Other Stories - Gary FredericksClojure: A live Demonstration of Simplicity That is Production Ready - Nir RubinsteinClojure vs Sepsis: path to real time enterprise data science - Igor Ges + Gerardo CastroScaling Full-Stack Applications - Wilker Lucio da SilvaCondition Systems in an Exceptional Language - Chris HouserComposing music with clojure.spec - Wojciech FrankeCan you GAN? - Carin MeierREBL - Stuart HallowayWhy Clojure? - Derek SlagerMaking Memories: Clojure For Hardware Engineers (And Others) - Aaron CummingsWhat Lies Beneath - A Deep Dive Into Clojure's Data Structures - Mohit ThatteInvited Talk - Guy SteeleDay of Datomic Cloud - Session 3AWS, meet Clojure - David ChelimskyMaybe Not - Rich HickeyZach Tellman - Always Be ComposingTables Considered Helpful - Daniel GregoireRobust APIs with clojure.spec & GraphQL - Lily Goh + Dom Kiva-Meyer