Skip to content

feat(ai): add AI libraries directory and metadata for the integrations page - #459

Open
jbrinkman wants to merge 20 commits into
valkey-io:mainfrom
jbrinkman:fix/ai-libraries-595
Open

feat(ai): add AI libraries directory and metadata for the integrations page#459
jbrinkman wants to merge 20 commits into
valkey-io:mainfrom
jbrinkman:fix/ai-libraries-595

Conversation

@jbrinkman

@jbrinkman jbrinkman commented Jul 17, 2026

Copy link
Copy Markdown

Description

Add a new ai/ directory to the valkey-doc repo containing JSON metadata for 14 AI/ML libraries that integrate with Valkey. This data will power the new "AI Libraries" page on the Valkey website.

This PR provides the data layer. The companion website PR (valkey-io/valkey-io.github.io#602) implements the page template and rendering.

Related Issues

Fixes valkey-io/valkey-io.github.io#595 — Add a Libraries and Frameworks integration page

Changes

New ai/ directory structure

  • ai/README.md — documents the JSON schema and contribution guidelines
  • 14 library JSON files organized by language (python/, javascript/, java/, lua/)

JSON schema with valkey_uses field

Each library entry includes:

  • name, description — what the library is and why you'd use it
  • valkey_uses — how Valkey is specifically used (vector store, caching, memory, session storage, etc.)
  • repo, installation, version, version_released, language, license

Libraries included

Language Library Valkey Use Case
Python Cognee Vector database adapter for AI memory
Python Haystack Document store with vector similarity search (RAG)
Python LangChain AWS Cache store and vector store for AWS integrations
Python OpenMemory Memory storage backend for cognitive memory
Python PraisonAI Caching layer for multi-agent workflows
Python Open WebUI Session storage and caching for chat histories
Python vLLM Caching backend for KV cache and vector storage
Python CocoIndex Vector store for semantic code search
Python DB-GPT Vector store and cache store for database queries
Python KServe Caching layer for model predictions
JavaScript Recall Memory storage backend for AI agent sessions
JavaScript OpenMemory Memory storage backend for cognitive memory
Java Langchain4j Embedding store for vector search
Lua Kong Rate limiting, caching, and session storage

Other changes

  • Updated repo README.md to document the new ai/ directory alongside clients, modules, libraries, and tools
  • Added resources/ai/index.md page metadata for the documentation site

Companion PRs

Testing

  • All 14 JSON files validated against the documented schema
  • Descriptions verified against GitHub project pages
  • Field ordering consistent across all files
  • Review feedback from @edlng incorporated (version dates, installation commands verified)

Add new /ai directory to store AI library metadata for libraries that
support Valkey. Includes README documentation and example JSON files for
popular AI frameworks (LangChain, Haystack, LlamaIndex, LangChain.js).

The JSON structure follows the same pattern as clients with fields for
name, description, repo, installation, version, language, and license.

Signed-off-by: Joseph Brinkman <joe.brinkman@improving.com>
Add resources/ai/index.md to define the AI libraries page metadata
for the Valkey documentation site. This follows the same pattern as
other resource types (clients, libraries, tools, modules).

Signed-off-by: Joseph Brinkman <joe.brinkman@improving.com>
Add JSON metadata for:
- Recall v1.7.0 (JavaScript/TypeScript MCP server for AI memory)
- Cognee Valkey Adapter v0.2.0 (Python vector database adapter)

Both libraries support Valkey for AI agent memory management
and vector storage.

Signed-off-by: Joseph Brinkman <joe.brinkman@improving.com>
Add JSON metadata for all completed Valkey AI integrations:
- Haystack Valkey Integration v0.2.0 (Python)
- LangChain AWS v1.4.1 (Python)
- OpenMemory v1.2.2 (Python & JavaScript)
- Langchain4j v1.15.0-beta25 (Java)
- PraisonAI v4.6.48 (Python)
- Open-WebUI v0.9.6 (Python)
- vLLM v0.3.0 (Python)
- CocoIndex v1.0.12 (Python)
- DB-GPT v0.8.1 (Python)
- Kong Gateway v3.9.2 (Lua)
- KServe v0.15.1 (Python)

Removed example files that were not on the completed projects list:
- LangChain.js (not completed)
- LlamaIndex (not completed)
- Generic LangChain (replaced with specific LangChain AWS)

All entries match the completed projects from the 2026-07-13 status report.

Signed-off-by: Joseph Brinkman <joe.brinkman@improving.com>
Update the AI libraries JSON schema to include a new valkey_uses field
that explains how each library uses Valkey (vector store, caching, memory
storage, etc.). Improve descriptions for all 14 AI libraries based on
GitHub project research to be more accurate and concise.

Changes:
- Update ai/README.md to document the new valkey_uses field
- Add valkey_uses field to all 14 AI library JSON files across Python,
  JavaScript, Java, and Lua languages
- Improve description field to be 1-2 sentences explaining what the
  library does and why someone would use it
- Reorganize field order: name, description, valkey_uses, repo,
  installation, version, version_released, language, license

Libraries updated:
- Python (10): cognee, haystack, langchain-aws, openmemory, praisonai,
  open-webui, vllm, cocoindex, db-gpt, kserve
- JavaScript (2): recall, openmemory
- Java (1): langchain4j
- Lua (1): kong

The new valkey_uses field will be displayed on the website between Repo
and Installation to better explain Valkey integration use cases.

Signed-off-by: Joseph Brinkman <joe.brinkman@improving.com>
@jbrinkman

Copy link
Copy Markdown
Author

Required by valkey-io/valkey-io.github.io#602

@edlng edlng left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A lot of these JSON files had incorrect version dates or ambiguous versions since they don't directly integrate Valkey (e.g., using LMCache for Valkey support instead). Some of them I've left room for discussion as to how we want to approach certain versions or repos. I've tested some of the installation commands too and they're OK.

That being said, this is just an initial review. After we finish the discussions I want to run the installations one more time to verify.

Also, In the PR description, we need to update the XXX at the bottom to match the companion PR's number.

Comment thread ai/java/langchain4j.json Outdated
Comment thread ai/javascript/openmemory.json Outdated
Comment thread ai/javascript/recall.json Outdated
Comment thread ai/python/cocoindex.json Outdated
Comment thread ai/python/db-gpt.json Outdated
Comment thread ai/python/haystack.json Outdated
Comment thread ai/java/langchain4j.json Outdated
Comment thread ai/java/langchain4j.json Outdated
Comment thread ai/javascript/openmemory.json
Comment thread README.md
jbrinkman and others added 15 commits July 20, 2026 14:44
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Co-authored-by: Edward Liang <76571219+edlng@users.noreply.github.com>
Signed-off-by: Joe Brinkman <joe.brinkman@improving.com>
Add metadata for five AI libraries using Valkey:
- Kong (Lua) - API gateway and microservices management
- Cognee (Python) - cognitive services framework
- Haystack (Python) - NLP framework
- Open WebUI (Python) - web interface for LLMs
- OpenMemory (Python) - memory management for AI agents

Signed-off-by: Joseph Brinkman <joe.brinkman@improving.com>
@jbrinkman
jbrinkman marked this pull request as ready for review July 22, 2026 19:29
@jbrinkman jbrinkman changed the title feat(ai): add valkey_uses field and improve library descriptions feat(ai): add AI libraries directory and metadata for the integrations page Aug 10, 2026

@madolson madolson left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have a structural issue with the PR. I don't really like that we just have a long collection of random versions of integrations. I would rather these be more like individual markdown files that link to more detail about the installation or integration with Valkey.

Comment thread README.md
H1 heading in each of the pages.

### Clients, modules, libraries, tools
### Clients, modules, libraries, tools, and AI libraries

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think AI libraries should be promoted to a top level entry above libraries.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add a Libraries and Frameworks integration page

3 participants