Wednesday, September 28, 2022
HomeSoftware EngineeringLakehouse Knowledge Stack with Raj Bains

Lakehouse Knowledge Stack with Raj Bains


Initially revealed on April 12, 2022.

As firms transfer to Spark and a Lakehouse structure, they’re realizing that the information instruments are lagging method behind.  You have to be a programmer to successfully use Spark and Airflow.

There are some low-code ETL instruments, however is that sufficient?  Firms need to deal with their knowledge pipelines like mission-critical apps.  They need DevOps for knowledge, with GIT, check protection, and CI/CD.  As well as, firms want end-to-end visibility of their knowledge pipelines, together with monitoring, metadata, and column-level lineage.

The place are the information instruments for these capabilities and the way do non-programmers use these?  

In as we speak’s podcast, you’ll see how Prophecy’s low-code knowledge engineering platform, constructed on Spark and Airflow, offers a whole resolution for growing, deploying, and monitoring knowledge pipelines.  We’ll communicate with Raj Bains, who’s the founder & CEO of Prophecy.  

Raj has spent twenty years constructing highly effective instruments – Microsoft Visible Studio, founding engineer for CUDA at NVIDIA, product supervisor for Hive at Hortonworks. He’s enthusiastic about making all organizations productive with knowledge and making the lives of information engineers higher by decreasing toil and rising the enjoyment.

Additionally, in the event you like what you hear, Prophecy has a particular supply for our listeners.  Go to Prophecy.IO/request-a-demo and put in “SED” for the referral code.  In the event you determine to buy inside 3 months of the demo, you get 10% off.  If you buy after 3 months, you continue to get 5% off.

Sponsorship inquiries: sponsor@softwareengineeringdaily.com

 

 

Transcript

Transcript supplied by We Edit Podcasts. Software program Engineering Every day listeners can go to weeditpodcasts.com to get 15% off the primary three months of audio modifying and transcription providers with code: SED. Due to We Edit Podcasts for partnering with SE Every day. Please click on right here to view this present’s transcript.



RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular