Skip to content

Commit ad17192

Browse files
committed
Blog post highlighting the recordings of our Data and AI Summit talks
1 parent 85421e2 commit ad17192

File tree

1 file changed

+47
-0
lines changed

1 file changed

+47
-0
lines changed
Lines changed: 47 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,47 @@
1+
---
2+
layout: post
3+
title: "Data and AI Summit Wrap-up"
4+
team: Core Platform
5+
author: rtyler
6+
tags:
7+
- databricks
8+
- kafka
9+
- deltalake
10+
- featured
11+
---
12+
13+
We brought a whole team to San Francisco to present and attend this year's Data and
14+
AI Summit, and it was a blast!
15+
I
16+
would consider the event a success both in the attendance to the Scribd hosted
17+
talks and the number of talks which discussed patterns we have adopted in our
18+
own data and ML platform.
19+
The three talks I [wrote about
20+
previously](/blog/2022/data-ai-summit-2022.html) were well received and have
21+
since been posted to YouTube along with _hundreds_ of other talks.
22+
23+
* [Christian Williams](https://github.com/xianwill) shared some of the
24+
work he has done developing
25+
[kafka-delta-ingest](https://github.com/scribd/kafka-delta-ingest) in his talk:
26+
**[Streaming Data into Delta Lake with Rust and
27+
Kafka](https://www.youtube.com/watch?v=do4jsxeKfd4&list=PLTPXxbhUt-YVWi_cf2UUDc9VZFLoRgu0l&index=195)
28+
* [QP Hou](https://github.com/houqp), Scribd Emeritus, presented on
29+
his foundational work to ensure correctness within delta-rs during his session:
30+
**[Ensuring Correct Distributed Writes to Delta Lake in Rust with Formal
31+
Verification](https://www.youtube.com/watch?v=ABoCnrVWCKY&list=PLTPXxbhUt-YVWi_cf2UUDc9VZFLoRgu0l&index=112)
32+
* [R Tyler Croy](https://github.com/rtyler) co-presented with Gavin
33+
Edgley from Databricks on the cost analysis work Scribd has done to efficiently
34+
grow our data platform with **[Doubling the size of the data lake without doubling the
35+
cost](
36+
https://www.youtube.com/watch?v=9QDRD0PzqCE&list=PLTPXxbhUt-YVWi_cf2UUDc9VZFLoRgu0l&index=122)
37+
38+
Members of the Scribd team participated in a panel to discuss the past,
39+
present, and future of Delta Lake on the expo floor. We also took advantage of
40+
the time to have multiple discussions with our colleagues at Databricks about
41+
their product and engineering roadmap, and where we can work together to
42+
improve the future of Delta Lake, Unity catalog, and more.
43+
44+
For those working in the data, ML, or infrastructure space, there are a lot of
45+
_great_ talks available online from the event, which I highly recommend
46+
checking out. Data and AI Summit is a great event for leaders in the industry
47+
to get together, so we'll definitely be back next year!

0 commit comments

Comments
 (0)