GNU ELPA - ellama

Just M-x package-install Enter ellama Enter. By default it uses ollama provider and zephyr model. If you ok with it, you need to install ollama and pull zephyr like this:

ollama pull zephyr

You can use ellama with other model or other llm provider. In that case you should customize ellama configuration like this:

;; YOU DON'T NEED NONE OF THIS CODE FOR SIMPLE INSTALL
;; IT IS AN EXAMPLE OF CUSTOMIZATION.
(use-package ellama
  :init
  ;; setup key bindings
  (setopt ellama-keymap-prefix "C-c e")
  ;; language you want ellama to translate to
  (setopt ellama-language "German")
  ;; could be llm-openai for example
  (require 'llm-ollama)
  (setopt ellama-provider
		  (make-llm-ollama
		   ;; this model should be pulled to use it
		   ;; value should be the same as you print in terminal during pull
		   :chat-model "mistral:7b-instruct-v0.2-q6_K"
		   :embedding-model "mistral:7b-instruct-v0.2-q6_K"))
  ;; Predefined llm providers for interactive switching.
  ;; You shouldn't add ollama providers here - it can be selected interactively
  ;; without it. It is just example.
  (setopt ellama-providers
		  '(("zephyr" . (make-llm-ollama
				 :chat-model "zephyr:7b-beta-q6_K"
				 :embedding-model "zephyr:7b-beta-q6_K"))
		    ("mistral" . (make-llm-ollama
				  :chat-model "mistral:7b-instruct-v0.2-q6_K"
				  :embedding-model "mistral:7b-instruct-v0.2-q6_K"))
		    ("mixtral" . (make-llm-ollama
				  :chat-model "mixtral:8x7b-instruct-v0.1-q3_K_M-4k"
				  :embedding-model "mixtral:8x7b-instruct-v0.1-q3_K_M-4k"))))
  ;; Naming new sessions with llm
  (setopt ellama-naming-provider
	  (make-llm-ollama
	   :chat-model "mistral:7b-instruct-v0.2-q6_K"
	   :embedding-model "mistral:7b-instruct-v0.2-q6_K"))
  (setopt ellama-naming-scheme 'ellama-generate-name-by-llm)
  ;; Translation llm provider
  (setopt ellama-translation-provider (make-llm-ollama
				       :chat-model "sskostyaev/openchat:8k"
				       :embedding-model "nomic-embed-text")))

Here is a table of keybindings and their associated functions in Ellama, using the ellama-keymap-prefix prefix (not set by default):

The following variables can be customized for the Ellama client:

• ellama-enable-keymap: Enable the Ellama keymap.
• ellama-keymap-prefix: The keymap prefix for Ellama.
• ellama-user-nick: The user nick in logs.
• ellama-assistant-nick: The assistant nick in logs.
• ellama-language: The language for Ollama translation. Default

language is english.

• ellama-provider: llm provider for ellama. Default provider is

ollama with zephyr model. There are many supported providers: ollama, open ai, vertex, GPT4All. For more information see llm documentation.

• ellama-providers: association list of model llm providers with name as key.
• ellama-spinner-type: Spinner type for ellama. Default type is

progress-bar.

• ellama-ollama-binary: Path to ollama binary.
• ellama-auto-scroll: If enabled ellama buffer will scroll automatically during generation. Disabled by default.
• ellama-fill-paragraphs: Option to customize ellama paragraphs filling behaviour.
• ellama-name-prompt-words-count: Count of words in prompt to generate name.
• Prompt templates for every command.
• ellama-chat-done-callback: Callback that will be called on ellama

chat response generation done. It should be a function with single argument generated text string.

• ellama-nick-prefix-depth: User and assistant nick prefix depth. Default value is 2.
• ellama-sessions-directory: Directory for saved ellama sessions.
• ellama-major-mode: Major mode for ellama commands. Org mode by default.
• ellama-long-lines-length: Long lines length for fill paragraph call. Too low value can break generated code by splitting long comment lines. Default value 100.
• ellama-session-auto-save: Automatically save ellama sessions if set. Enabled by default.
• ellama-naming-scheme: How to name new sessions.
• ellama-naming-provider: LLM provider for generating session names by LLM. If not set ellama-provider will be used.
• ellama-chat-translation-enabled: Enable chat translations if set.
• ellama-translation-provider: LLM translation provider. ellama-provider will be used if not set.

Thanks Jeffrey Morgan for excellent project ollama. This project cannot exist without it.

Thanks zweifisch - I got some ideas from ollama.el what ollama client in Emacs can do.

Thanks Dr. David A. Kunz - I got more ideas from gen.nvim.

Thanks Andrew Hyatt for llm library. Without it only ollama would be supported.