|
| 1 | +--- |
| 2 | +layout: post |
| 3 | +title: "Data and AI Summit Wrap-up" |
| 4 | +team: Core Platform |
| 5 | +author: rtyler |
| 6 | +tags: |
| 7 | +- databricks |
| 8 | +- kafka |
| 9 | +- deltalake |
| 10 | +- featured |
| 11 | +--- |
| 12 | + |
| 13 | +We brought a whole team to San Francisco to present and attend this year's Data and |
| 14 | +AI Summit, and it was a blast! |
| 15 | +I |
| 16 | +would consider the event a success both in the attendance to the Scribd hosted |
| 17 | +talks and the number of talks which discussed patterns we have adopted in our |
| 18 | +own data and ML platform. |
| 19 | +The three talks I [wrote about |
| 20 | +previously](/blog/2022/data-ai-summit-2022.html) were well received and have |
| 21 | +since been posted to YouTube along with _hundreds_ of other talks. |
| 22 | + |
| 23 | +* [Christian Williams](https://github.com/xianwill) shared some of the |
| 24 | +work he has done developing |
| 25 | +[kafka-delta-ingest](https://github.com/scribd/kafka-delta-ingest) in his talk: |
| 26 | +**[Streaming Data into Delta Lake with Rust and |
| 27 | +Kafka](https://www.youtube.com/watch?v=do4jsxeKfd4&list=PLTPXxbhUt-YVWi_cf2UUDc9VZFLoRgu0l&index=195) |
| 28 | +* [QP Hou](https://github.com/houqp), Scribd Emeritus, presented on |
| 29 | +his foundational work to ensure correctness within delta-rs during his session: |
| 30 | +**[Ensuring Correct Distributed Writes to Delta Lake in Rust with Formal |
| 31 | +Verification](https://www.youtube.com/watch?v=ABoCnrVWCKY&list=PLTPXxbhUt-YVWi_cf2UUDc9VZFLoRgu0l&index=112) |
| 32 | +* [R Tyler Croy](https://github.com/rtyler) co-presented with Gavin |
| 33 | +Edgley from Databricks on the cost analysis work Scribd has done to efficiently |
| 34 | +grow our data platform with **[Doubling the size of the data lake without doubling the |
| 35 | +cost]( |
| 36 | +https://www.youtube.com/watch?v=9QDRD0PzqCE&list=PLTPXxbhUt-YVWi_cf2UUDc9VZFLoRgu0l&index=122) |
| 37 | + |
| 38 | +Members of the Scribd team participated in a panel to discuss the past, |
| 39 | +present, and future of Delta Lake on the expo floor. We also took advantage of |
| 40 | +the time to have multiple discussions with our colleagues at Databricks about |
| 41 | +their product and engineering roadmap, and where we can work together to |
| 42 | +improve the future of Delta Lake, Unity catalog, and more. |
| 43 | + |
| 44 | +For those working in the data, ML, or infrastructure space, there are a lot of |
| 45 | +_great_ talks available online from the event, which I highly recommend |
| 46 | +checking out. Data and AI Summit is a great event for leaders in the industry |
| 47 | +to get together, so we'll definitely be back next year! |
0 commit comments