this post was submitted on 06 Mar 2024
11 points (100.0% liked)

LocalLLaMA

2569 readers
22 users here now

Community to discuss about LLaMA, the large language model created by Meta AI.

This is intended to be a replacement for r/LocalLLaMA on Reddit.

founded 2 years ago
MODERATORS
SkySyrup
pax
noneabove1182
11
T-Ragx - Enhancing Translation with RAG-Powered LLMs (github.com)
submitted 11 months ago by [email protected] to c/localllama
3 comments fedilink hide all child comments
 

Excited to share my T-Ragx project! And here are some additional learnings for me that might be interesting to some:

  • vector databases aren't always the best option
    • Elasticsearch or custom retrieval methods might work even better in some cases
  • LoRA is incredibly powerful for in-task applications
  • The pace of the LLM scene is astonishing
    • TowerInstruct and ALMA-R translation LLMs launched while my project was underway
  • Above all, it was so fun!

Please let me know what you think!

top 3 comments
sorted by: hot top controversial new old
[–] [email protected] 1 points 11 months ago* (last edited 11 months ago) (1 children)

Can you elaborate on why vector databases arent the best option? also really cool project.

[–] [email protected] 4 points 11 months ago (1 children)

Thanks! Vector databases store the semantic vector representation of each record and compare it to the query for retrieval, which would give results close to the meaning of the text, but not necessary the text surface. A lexical search, i.e. BM25 and levenshtein distance, seems to work better as translation examples in this case

[–] [email protected] 1 points 11 months ago

Understood, very cool. Thank you. will have to explore this more!!