The idea is to use an open-source, large language model (LLM) that runs completely on-device/offline on Android devices. This LLM would offer full functionality without the need for an internet connection, meaning it can handle tasks locally without sending data to external servers. The focus here is privacy and performance.

However, the key feature isn’t just the on-device capability. What sets this LLM apart is open access. Any app or service — whether it’s a first-party or third-party application — should be able to integrate and use the model without restrictions. The goal is to make an advanced LLM that anyone can use, not just a limited set of apps.

Why Open Access?

Most on-device models today are locked behind company ecosystems. For example, Apple’s intelligence features are only available to a few apps, and similar limitations apply to models like Gemini Nano on Android. This restricts their use and limits innovation.

By making the LLM open-source and open-access, any developer can tap into the model’s capabilities. This opens up the possibility for a wide range of applications. It encourages developers to experiment and build solutions that don’t rely on a company’s approval or cloud services.

Use Cases

Here are a few possible use cases for such an LLM:

1. Basic Tasks: Apps could use the model for tasks like document generation, image analysis, or summarization — all done locally on the device.
2. Media Processing: A podcast app could use the LLM to analyze audio files, generate transcripts, and create chapters based on content, giving users better control over their listening experience. Similarly, video apps could generate summaries or chapter divisions for videos.
3. General Applications: Any app that needs advanced language capabilities, from note-taking to customer support tools, could integrate this LLM without needing to worry about privacy concerns or server limitations.

Conclusion

The main idea here is to build an LLM that operates entirely on-device for privacy and speed while keeping it open and accessible to everyone. This approach allows developers to innovate freely and creates opportunities for new use cases across apps. The combination of on-device processing with open access makes this model unique and scalable across various industries.

Let me know what you think about the idea. I’m pretty sure it must have been conceived many times before me. I want to know how feasible it is and what technical limitations are there.

It was meant to prove that AI need not be commercial and corporate-y. It can be something privacy-respecting and open to all. I chose Android because it’s open and easier to hack around.

Expectations piling up,
Sinew breaking down,
Resolve loosening,
You march on, going nowhere.

Chest puffed, chin up, you begin your daily battle.
Creased brow, hunched back, you drag your feet.

Toiling to make a rich man you don’t care about richer.
And losing your mind in the process.

Fuelling the brazen pot of greed,
Slaving and selling yourself.

Building stuff you wouldn’t use,
Selling things to people who don’t want it.

Desperately fighting for relevance,
Fending off loneliness,
Accumulating points for a game you’re losing.

You look back, so much has passed, so much lost.
You fall into your dirty bed, all dead on the inside,
What is the purpose of it all?

A Writhing Soul was originally published in Blue Insights on Medium, where people are continuing the conversation by highlighting and responding to this story.

A few lines on how things change

We were happy together, had each other despite all and everyone.

You forsook me when I needed you the most.

Now, the seconds tick slower than the hours.

Love yourself never felt more meaningless.

The gap you left in my empty heart has crystallised.

A spectacle you were to the heart, now you are only a trigger.

The reality that you’re better off without me and happier, too, is a painful truth to acknowledge.

I don’t move on easily.

I never had anyone. Only a person without friends knows the value of friendship and love. And when I love someone, I give them all of my self.

You broke me and left me to pick up my pieces. I will fix myself; I will heal.

I don’t hate you, no, quite the contrary; I still love you with all my heart. I love you with a thousand hearts. You were my best friend; we understood each other like we were each other.

The optimistic romantic that I am, I will never stop loving you. Though I know its futility.

A ship without sails I float around in a nebula. Directionless and windless.

What’s broken can be mended, or so I thought. I read the wrong signs and the signs wrong.

We are responsible for our own disappointment, I learnt the hard way.

So on I float, in my zombie-like existence looking forward to the past.

We Were Happy Together was originally published in Blue Insights on Medium, where people are continuing the conversation by highlighting and responding to this story.

My room smelled of your perfume,
My thoughts flooded with the memory of you.

The two just as fragrant and alluring,
Bringing a smile upon my face.

Beautiful in every which way, You buoy my sinking soul with your grin.
As I sit here, struggling to yank the words out of my in-spate heart, You come by with your gentle giggle, easing the rope out of my hands and the words out of their shell.

Your Fragrance was originally published in Blue Insights on Medium, where people are continuing the conversation by highlighting and responding to this story.

Take my hand,
Let’s intertwine our fingers.
Let me give you a twirl,
Then fall into my arms.

Shine light upon my dark heart with your smile.
Let me know that it will be okay.

I’m yours, be mine
in the pacific togetherness that trust and love catalyse.

Let me hold you while I hold onto you.
Let us exist in each other’s existence, outside of the world’s worlds.

Just you and me.
Just you and me.

Just You And Me was originally published in Blue Insights on Medium, where people are continuing the conversation by highlighting and responding to this story.

But how can a writer write when there’s nothing to write from and no one to write to?
You, my greatest muse, are dead to me.

You lit the spark, stoked the fire, and blew on it till it erupted.
Now, you are the cold breeze that puts it out.

I’ve looked for you in great books, in broken hearts, in the beauty of the beautiful.
I’ve searched for you in my travels, inward and outward.
Never did I find, such a muse as musical as you.

I postponed life and living to tend to you.
I thought we were one as you were another me.

I second-guessed myself on every word I wrote,
To accord you the deservedness you deserved.

And yet, here you are now, as distant as the twilight sky,
But just as alluring.

And so we are and so be it.

My Muse was originally published in Blue Insights on Medium, where people are continuing the conversation by highlighting and responding to this story.

Every day I’d go to the park, sit on the bench, and watch, as little children played with each other, and sang like the world has no worries for them, and I would be transported back to my childhood.

That’s all I had asked for: a time machine that worked.

A Time Machine was originally published in Weeds & Wildflowers on Medium, where people are continuing the conversation by highlighting and responding to this story.

A few words on how they beckon to me

The lost pages of my diary beckon to me.
Another sad poem, a practical prose.
All words too deep to be felt by any heart,
Only the paper being able to bear the brunt of my ‘heart’s attacks’.
Each word as candid and as contentious as the next.

The lost pages of my diary beckon to me,
Filled with unshed tears, unspoken words, and unheard prayers.

They said to me one day, “What’s it gonna take for you to lift your butt up and do what it takes?”
They’re a burning reminder for me to go ahead and live the life I always wanted.

One that has seen my troughs and highs, my tears and laughter, my best and worst, judging me neutrally.
The only one who knows me better than me;
The lost pages of my diary beckon to me.

The Lost Pages Of My Diary was originally published in Blue Insights on Medium, where people are continuing the conversation by highlighting and responding to this story.

Listless afternoons,
Empty beers for company.
Nights that never end.

Are you that unwritten poem that I always procrastinate to write.

Are you that unshed tear I struggle to shed.

Are you that unforgotten memory from childhood that haunts me.

Are you that song in my mind that makes me sad when I’m happy,
And happy when I’m sad.

Are you the wheel of time that reminds me of harsh reality.

I don’t know from where you’ve come;
I don’t know where to will you take me.

All I know is:

I’ve loved you before I knew what love was,
And will do so after I forget what it is.

© Srinath 2021

Are You That? was originally published in Literally Literary on Medium, where people are continuing the conversation by highlighting and responding to this story.