Description:
Currently, the OPENAI_API_KEY seems to be hardcoded specifically for OpenAI's services. Could we add support for users to customize and configure their own preferred LLM vendors, rather than being limited to only OpenAI?

This would allow greater flexibility for users who want to use alternative LLM providers while maintaining the same interface and functionality.