Loading…
← Back to schedule
[Virtual Exclusive] OPEN SESSION (CloudX): Adding Generative AI to Real-Time Streaming Pipelines
Thursday November 14, 2024 12:00pm - 12:25pm PST
VIRTUAL CloudX -- Main Stage
Timothy Spann, Zilliz, Principal Developer Advocate

In this talk I walk through various use cases where bringing real-time data to LLM solves some interesting problems.

In one case we use Apache NiFi to provide a live chat between a person in Slack and several LLM models all orchestrated via NiFi and Kafka. In another case NiFi ingests live travel data and feeds it to HuggingFace and OLLAMA LLM models for summarization. I also do live chatbot. We also augment LLM prompts and results with live data streams. All with ASF projects. I call this pattern FLaNK AI.
Speakers
avatar for Timothy Spann

Timothy Spann

Principal Developer Advocate, Zilliz
Tim Spann is the Principal Developer Advocate for Data in Motion @ Zilliz. Tim has over a decade of experience with the IoT, big data, distributed computing, streaming technologies, and Java programming. Previously, he was a Developer Advocate at StreamNative, Principal Field Engineer... Read More →
Thursday November 14, 2024 12:00pm - 12:25pm PST
VIRTUAL CloudX -- Main Stage
  OPEN SESSIONS, CloudX
Feedback form is now closed.

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Share Modal

Share this link via

Or copy link