Try-Monads With Big Data Using PySpark
2:00pm - 2:25pm on Friday, October 6 in PennTop NorthJordan Yaker
- Audience Level:
- Intermediate
- Slides:
- https://www.slideshare.net/jordanyaker/trymonads-with-big-data-using-pyspark
- Watch:
- https://youtu.be/30lNjCfwtdw
Overview
Stream data processing is a complex and challenging process. Data is often imprecise and murky at best. How do we reconcile these two facts?
The answer is: Try-Monads.
Come learn what a Try-Monad and see the code necessary to implement and use one within your PySpark projects.
Description
Tired of errors killing your code when they happen? Do you often think about whether Schrödinger’s cat is truly dead or alive? Monads are the answer to the woes that plague your life!
This talk will cover the following topics:
- What exactly is a Monad?
- Ok, so what’s a Try-Monad?
- How will a Try-Monad help with Stream Processing?
- How do I add a Try-Monad to a PySpark application?
- How do I test my Monad-ified code?
If you’re interested in writing Python Stream Processing applications that can handle errors gracefully then this talk is for you!