Initially printed on April 12, 2022.
As firms transfer to Spark and a Lakehouse structure, they’re realizing that the info instruments are lagging approach behind. It is advisable to be a programmer to successfully use Spark and Airflow.
There are some low-code ETL instruments, however is that sufficient? Firms need to deal with their information pipelines like mission-critical apps. They need DevOps for information, with GIT, take a look at protection, and CI/CD. As well as, firms want end-to-end visibility of their information pipelines, together with monitoring, metadata, and column-level lineage.
The place are the info instruments for these capabilities and the way do non-programmers use these?
In in the present day’s podcast, you’ll see how Prophecy’s low-code information engineering platform, constructed on Spark and Airflow, gives an entire answer for growing, deploying, and monitoring information pipelines. We’ll communicate with Raj Bains, who’s the founder & CEO of Prophecy.
Raj has spent twenty years constructing highly effective instruments – Microsoft Visible Studio, founding engineer for CUDA at NVIDIA, product supervisor for Hive at Hortonworks. He’s obsessed with making all organizations productive with information and making the lives of knowledge engineers higher by lowering toil and growing the enjoyment.
Additionally, for those who like what you hear, Prophecy has a particular supply for our listeners. Go to Prophecy.IO/request-a-demo and put in “SED” for the referral code. In case you resolve to buy inside 3 months of the demo, you get 10% off. If you buy after 3 months, you continue to get 5% off.
Sponsorship inquiries: sponsor@softwareengineeringdaily.com
Transcript
Transcript offered by We Edit Podcasts. Software program Engineering Each day listeners can go to weeditpodcasts.com to get 15% off the primary three months of audio modifying and transcription companies with code: SED. Because of We Edit Podcasts for partnering with SE Each day. Please click on right here to view this present’s transcript.