Code

merge upstream#32

Code

Merged

l3utterfly merged 28 commits intol3utterfly:masterl3utterfly/llama.cpp:masterfrom ggml-org:masterggml-org/llama.cpp:masterCopy head branch name to clipboardAug 12, 2024

+3,925-654

Commits

Commits on Aug 8, 2024

• make : clean llamafile objects (#8923)

  Show description for ebd541a
  DrDub

  authored
  ebd541a

  Copy full SHA for ebd541a

• metal : add abort callback (ggml/905)

  

  conradev

  authored and

  ggerganov

  committed
  85fca8d

  Copy full SHA for 85fca8d

• metal : fix struct name (ggml/912)

  Show description for 5b33ea1
  ggerganov

  committed
  5b33ea1

  Copy full SHA for 5b33ea1

• ggml : ignore more msvc warnings (ggml/906)

  

  iboB

  authored and

  ggerganov

  committed
  f93d49a

  Copy full SHA for f93d49a

• sync : ggml

  ggerganov

  committed
  e44a561

  Copy full SHA for e44a561

• scripts : fix sync filenames (#0)

  ggerganov

  committed
  366d486

  Copy full SHA for 366d486

• scripts : sync cann files (#0)

  ggerganov

  committed
  afd27f0

  Copy full SHA for afd27f0

• gguf-py : simplify support for quant types (#8838)

  Show description for 3a14e00
  compilade

  authored
  3a14e00

  Copy full SHA for 3a14e00

Commits on Aug 9, 2024

• llama : reduce useless copies when saving session (#8916)

  Show description for 345a686
  compilade

  authored
  345a686

  Copy full SHA for 345a686

• server : add one level list nesting for embeddings (#8936)

  gelim

  authored
  daef3ab

  Copy full SHA for daef3ab

• llama : fix typo in llama_tensor_get_type comment [no ci] (#8937)

  danbev

  authored
  6f6496b

  Copy full SHA for 6f6496b

• embedding : add --pooling option to README.md [no ci] (#8934)

  Show description for 5b2c04f
  danbev

  authored
  5b2c04f

  Copy full SHA for 5b2c04f

• whisper : use vulkan as gpu backend when available (whisper/2302)

  Show description for 70c0ea3
  

  mstephenson6

  authored and

  ggerganov

  committed
  70c0ea3

  Copy full SHA for 70c0ea3

• sync : ggml

  ggerganov

  committed
  4305b57

  Copy full SHA for 4305b57

• llava : support MiniCPM-V-2.5 (#7599)

  Show description for 3071c0a
  

  4 peopleauthored
  3071c0a

  Copy full SHA for 3071c0a

• llama : better replace_all (cont) (#8926)

  Show description for 45a55b9
  ggerganov

  authored
  45a55b9

  Copy full SHA for 45a55b9

• make : fix llava obj file race (#8946)

  Show description for 272e3bd
  ggerganov

  authored
  272e3bd

  Copy full SHA for 272e3bd

• llama : add support for lora adapters in T5 model (#8938)

  Show description for 6afd1a9
  

  fairydreaming

  and

  sszymczy

  authored
  6afd1a9

  Copy full SHA for 6afd1a9

• Merge commit from fork

  ggerganov

  authored
  b72942f

  Copy full SHA for b72942f

Commits on Aug 10, 2024

• gguf-py : fix double call to add_architecture() (#8952)

  Show description for 911b437
  tarilabs

  authored
  911b437

  Copy full SHA for 911b437

• Add support for encoder-only T5 models (#8900)

  Show description for 7c3f55c
  

  fairydreaming

  and

  sszymczy

  authored
  7c3f55c

  Copy full SHA for 7c3f55c

• llama : default n_swa for phi-3 (#8931)

  Show description for 7eb2384
  ngxson

  authored
  7eb2384

  Copy full SHA for 7eb2384

• metal : fix uninitialized abort_callback (#8968)

  slaren

  authored
  6e02327

  Copy full SHA for 6e02327

Commits on Aug 11, 2024

• Optimize Vulkan backend for better CPU performance and less GPU synchronization overhead. (#8943)

  Show description for 7c5bfd5
  

  mtavenrath

  and

  0cc4m

  authored
  7c5bfd5

  Copy full SHA for 7c5bfd5

• llama : check all graph nodes when searching for result_embd_pooled (#8956)

  Show description for 33309f6
  

  fairydreaming

  and

  sszymczy

  authored
  33309f6

  Copy full SHA for 33309f6

• update guide (#8909)

  Show description for a21c6fd
  arthw

  authored
  a21c6fd

  Copy full SHA for a21c6fd

• flake.lock: Update (#8979)

  ggerganov

  authored
  8cd1bcf

  Copy full SHA for 8cd1bcf

• gguf-py : Numpy dequantization for most types (#8939)

  Show description for 4134999
  compilade

  authored
  4134999

  Copy full SHA for 4134999