Unveiling much Simplified Functional Programming in Scala • Afsal Thaj • YOW! 2020
This presentation was recorded at YOW! 2020. #GOTOcon #YOW
https://yowcon.com
Afsal Thaj - Principal Consultant at Simple Machines
ORIGINAL TALK TITLE
Unveiling much Simplified Functional Programming in Scala for Data Engineering
RESOURCES
https://www.linkedin.com/in/afsal-thaj-10ab2842
https://twitter.com/afsalt2
https://medium.com/@afsal-taj06
ABSTRACT
I will talk about a much simplified version of #FunctionalProgramming in #Scala, in building an abstraction for Feature Generation in #DataEngineering space.
The program made using this abstraction will get interpreted to the popular data source languages of our choice - such as #Spark or #Flink. However, before it gets interpreted to any of these engines, we will explain how these programs could be optimised by introspecting its nodes, and help run these interpretations faster. The core idea is similar to that of Free Applicative, however, implementing it in Scala hasn't been straight forward. Here, we provide a similar capability but without mentioning much about FreeAp, and without the usual Scala boilerplates of implicits, macros and a proliferated usage of type classes.
The purpose of the talk is not just to demonstrate a set of code, but to showcase the fact that sticking on to fundamentals of Functional Programming, and finding the right abstraction enables writing solutions quickly and relatively easily.
It proves we don't need to learn a bulk of libraries to apply these concepts in real world applications. The learning curve and a massive set of libraries was often termed as the functional programming in Scala industry, resulting in lesser adoption and developers moving away from it. With this talk my intention is to motivate developers to come back and start writing FP even if they are in the world of #JVM. [...]
RECOMMENDED BOOKS
Martin Odersky • Programming in Scala 5th Edition • https://amzn.to/44rXiaM
Joshua D. Suereth • Scala in Depth • https://amzn.to/3QVADk6
https://twitter.com/GOTOcon
https://www.linkedin.com/company/goto-
https://www.instagram.com/goto_con
https://www.facebook.com/GOTOConferences
#ApacheSpark #ApacheFlink #ScalaLang #Programming #AfsalThaj #YOWcon
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech
Sign up for updates and specials at https://gotopia.tech/newsletter
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
https://www.youtube.com/user/GotoConferences/?sub_confirmation=1
Видео Unveiling much Simplified Functional Programming in Scala • Afsal Thaj • YOW! 2020 канала GOTO Conferences
https://yowcon.com
Afsal Thaj - Principal Consultant at Simple Machines
ORIGINAL TALK TITLE
Unveiling much Simplified Functional Programming in Scala for Data Engineering
RESOURCES
https://www.linkedin.com/in/afsal-thaj-10ab2842
https://twitter.com/afsalt2
https://medium.com/@afsal-taj06
ABSTRACT
I will talk about a much simplified version of #FunctionalProgramming in #Scala, in building an abstraction for Feature Generation in #DataEngineering space.
The program made using this abstraction will get interpreted to the popular data source languages of our choice - such as #Spark or #Flink. However, before it gets interpreted to any of these engines, we will explain how these programs could be optimised by introspecting its nodes, and help run these interpretations faster. The core idea is similar to that of Free Applicative, however, implementing it in Scala hasn't been straight forward. Here, we provide a similar capability but without mentioning much about FreeAp, and without the usual Scala boilerplates of implicits, macros and a proliferated usage of type classes.
The purpose of the talk is not just to demonstrate a set of code, but to showcase the fact that sticking on to fundamentals of Functional Programming, and finding the right abstraction enables writing solutions quickly and relatively easily.
It proves we don't need to learn a bulk of libraries to apply these concepts in real world applications. The learning curve and a massive set of libraries was often termed as the functional programming in Scala industry, resulting in lesser adoption and developers moving away from it. With this talk my intention is to motivate developers to come back and start writing FP even if they are in the world of #JVM. [...]
RECOMMENDED BOOKS
Martin Odersky • Programming in Scala 5th Edition • https://amzn.to/44rXiaM
Joshua D. Suereth • Scala in Depth • https://amzn.to/3QVADk6
https://twitter.com/GOTOcon
https://www.linkedin.com/company/goto-
https://www.instagram.com/goto_con
https://www.facebook.com/GOTOConferences
#ApacheSpark #ApacheFlink #ScalaLang #Programming #AfsalThaj #YOWcon
Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech
Sign up for updates and specials at https://gotopia.tech/newsletter
SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
https://www.youtube.com/user/GotoConferences/?sub_confirmation=1
Видео Unveiling much Simplified Functional Programming in Scala • Afsal Thaj • YOW! 2020 канала GOTO Conferences
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
![An Infrastructure in Line with My Requirements • Erwan Alliaume & Eric Favre • YOW! 2018](https://i.ytimg.com/vi/R2We32C6g40/default.jpg)
![Using Serverless & ARM64 for Real-Time Observability • Liz Fong-Jones • GOTO 2023](https://i.ytimg.com/vi/nI15yE2yIoI/default.jpg)
![Estimates or No Estimates? • Woody Zuill • YOW! 2017](https://i.ytimg.com/vi/xVFjTJ7Wrzs/default.jpg)
![The Value Flywheel Effect: A Modern Cloud Strategy • David Anderson & Charles Humble • GOTO 2024](https://i.ytimg.com/vi/WVAUHT-Jy-U/default.jpg)
![Introduction to Recursion Schemes • Amy Wong • YOW! 2018](https://i.ytimg.com/vi/ES6a5Hq4aUU/default.jpg)
![Platform Engineering as a (Community) Service • Nicki Watt • GOTO 2021](https://i.ytimg.com/vi/4N2ywun-wTE/default.jpg)
![Infrastructure As Code • Martin Fowler • YOW! 2016](https://i.ytimg.com/vi/5AGEv0sAw6g/default.jpg)
![C4 Models as Code • Simon Brown • YOW! 2022](https://i.ytimg.com/vi/f7i2wxQVffk/default.jpg)
![Simplifying Systems with Elixir • Sasa Juric • YOW! 2020](https://i.ytimg.com/vi/EDfm2fVS4Bo/default.jpg)
![Simple Functional Effects with Tag Unions • Richard Feldman • YOW! 2022](https://i.ytimg.com/vi/7SidSvJcPd0/default.jpg)
![Idioms for Building Fault-tolerant Applications with Elixir • José Valim • YOW! 2021](https://i.ytimg.com/vi/mkGq1WoEvI4/default.jpg)
![Architects Live in the First Derivative • Gregor Hohpe • YOW! 2019](https://i.ytimg.com/vi/5B9xPo8U9JU/default.jpg)
![Prioritizing Technical Debt as If Time & Money Matters • Adam Tornhill • GOTO 2022](https://i.ytimg.com/vi/w9YhmMPLQ4U/default.jpg)
![eBPF: Fueling New Flame Graphs & more • Brendan Gregg • YOW! 2022](https://i.ytimg.com/vi/HKQR7wVapgk/default.jpg)
![Microservices • Martin Fowler • YOW! 2016](https://i.ytimg.com/vi/z8qhToMtYRc/default.jpg)
![Event Sourcing • Martin Fowler • YOW! 2016](https://i.ytimg.com/vi/ck7t592bvBg/default.jpg)
![Getting to Grips with Kubernetes RBAC • Liz Rice • GOTO 2019](https://i.ytimg.com/vi/4HMRFcg6nEY/default.jpg)
![The Power & Performance of Phoenix LiveView • Geoffrey Lessel • GOTO 2021](https://i.ytimg.com/vi/-Rl-26JJ6js/default.jpg)
![ING's Journey to Agile • Henk Kolk • GOTO 2015](https://i.ytimg.com/vi/LrWUik_I1-Y/default.jpg)
![Securing Danish Healthcare Using Cloud Native • Frederik Mogensen • GOTO 2021](https://i.ytimg.com/vi/wiU3QIcf4fU/default.jpg)
![Migrating to Kubernetes + Best Practices for Cloud Native • T. Vitale & L. Højgaard • GOTO 2021](https://i.ytimg.com/vi/2J3MZlXjLHk/default.jpg)