Sitemap

chatSURF

WIP / DEVELOP / PROTOTYPE

3 min readJan 29, 2024

--

_______________________ WIP DOCUMENT

OVERVIEW

Conversational Assistant powered by ChatGPT

WHAT IS IT?

It’s a conversational assistant designed for exploring various creators and related artists. It offers guided and categorized modes, allowing for an easy and interactive experience through a video game-style interface.

WHERE?

This takes place in a large installation with a big screen. Users interact using a simple device, which could be a mechanical or touch keyboard, a gamepad, a custom four-button panel, or even a microphone.

SCREENSHOTS

Press enter or click to view image in full size
The text input box for typing the prompts, and the floating menu with the main options.

FEATURES

  • A Guided and categorized Creators Explorer:
  • A Conversation Assistant.
  • Powered by OpenAI ChatGPT API and/or other LLM local engines.
  • Designed to dive into different types of creators or artists,
    as well as
    Explore other similar or related ones.
  • Ask and get similar creators.
    - Summarizations, Sentences or Keywords.
  • Response Text-To-Voice using ElevenLabs.

WORKFLOW

  • Prompt a Text in the input box.
    Ask by keyboard/touch screen or even microphone.
Press enter or click to view image in full size
User types each prompt here and clicks the “Submit” button.
  • Play around the clickable floating menu.
User can click the floating menu buttons and select to receive: key “Sentences” ROLE for “Music Bands” AREA.
  • Explore for different Creators Areas or Categories:
    - Music Band
    - Book Writer
    - Film Director
    - Film Actor
    - Film Title
    - Illustrator
    - Painter
    - Philosopher
Press enter or click to view image in full size
After prompting for “Bifo Berardi”, in the “Book Writer” AREA and with the “Default” ROLE, we get a paragraph description of the creator.

    Get moebiusSurfing’s stories in your inbox

    Join Medium for free to get updates from this writer.

  • Get Similar/Related
    - Creators
    - Music albums
    - Books
    - Paintings
    - Films.
    By the author or related to his style, his artistic movement, friendship, countryman or contemporary, …etc.
Prompting for “Taxi Driver”, we can get the main “10” actors from the film. We can ask for more again to get a description of each actor performance.
  • Enjoy a guided conversation. Ask for a prompt and Get:
    - Summarizations.
    - Sentences or descriptive key phrases.
    - List of keywords.
    - Similar to.
Press enter or click to view image in full size
Here we prompt for “Portishead”, for the “Music Band” AREA. We get “10" keywords that describe the band. Then we list “10” other similar bands to explore about and dive around this music style.
  • Customize the response size:
    - Short, Medium, Long, or Unlimited.
  • Text-to-speech from the response.
    - Using ElevenLabs API.
  • Videogame styled:
    - State-of-the-Art interface rendering and animations.
    - Responsive layout for every screen size: landscape or portrait.
    - Sony Playstation / Microsoft XBOX game consoles inspired UI workflow.
    - UI sounds for a full nice experience.

WORKFLOW / VIDEO CAPTURES

Press enter or click to view image in full size
After prompting about “John Frusciante” we can explore his activity in other areas, his favorite bands, personal struggles, his artwork and exhibitions… besides his well known guitar player role.

UPGRADES / IDEAS / TODO

  • Input text using the Voice-To-Text feature using OpenAI Whisper API.
  • Query search after the response to get and auto-play music songs or even videos from YouTube, using the Google API or SerpApi.

RELATED MODULES / UPGRADES / OTHER PROJECTS

OpenAI Whisper listens to the incoming audio in real time. After converting to text as .srt subtitles/slides, they are displayed as animated and styled.
Many text files are opened. Each file has its own column to print all the paragraphs. Each canvas layout has different columns, sizes, fonts, colors, and styles. All the content is rendered and smoothly animated in real-time.
  • SerpAPI FOR A YOUTUBE PLAYER
    - Get the assistant answer, and query it as a search to YouTube.
    - Get the URL to the top result: a video or an audio.
    - Preload that content and play a sound in the background or even display a video with audio.
    https://github.com/moebiussurfing/ofxSerpAPI
Press enter or click to view image in full size
Passing a query search (a prompt answer in our case) to the YouTube API, we can get the top link to easily auto play a relevant song from a music band.

AUTHOR

A prototype developement by @moebiusSurfing
( ManuMolina ) 2024.

--

--