@amitiitbhu
@amitiitbhu
Article

In this blog, we will learn about Prefill-Decode Disaggregation, a way of running a large language model where the reading of the prompt and the writing of the answer happen on separate machines. We will also see how an LLM answers a request in two phases, what the KV Cache is, why the two phases ne...

1ย month ago
119
@ashxhart
@ashxhart
Article

I told one AI model I had a doctor's appointment on Tamar Lane....

1ย month ago
150
@0xRicker
@0xRicker
Article

A swarm knows how to execute. It does not know when to stop, what to run next, or whether a result is good enough. Those are decisions, and a decision on every turn is what keeps a human in the loop. Move them to Jev and the loop runs itself....

1ย month ago
255
@pamcosta21
@pamcosta21
Video

kkkkkkkkkkkkkkkkkkkkkkk NรƒO CONSEGUE NEM FALAR O NOME DO XANDรƒO, QUE COISA HEIN?! ...

1ย month ago
107
@Marcos_Luque_
@Marcos_Luque_
Thread

Para un estadounidense, un alemรกn, un inglรฉs, un japonรฉs o para alguien de la mayorรญa de paรญses, comprar acciones USA en Interactive Brokers es la mejor opciรณn. El mejor broker del mundo. Para un espaรฑol, en cambio, es una NEGLIGENCIA FINANCIERA. Me explico ๐Ÿงต ...

1ย month ago
11
@byomong
@byomong
Thread

์ปด๋ฐฑ ๊ธฐ๊ฐ„ ๋™์•ˆ ๋ชธ์„ ํ—˜ํ•˜๊ฒŒ ๊ตด๋ฆฌ๋˜ ๋ฐ•๋ฌธ๋Œ€๋Š” ์ด๋ฒˆ์—๋„ ๋ชธ์‚ด๊ฐ๊ธฐ์— ๊ฑธ๋ฆผ. ๋ฉค๋ฒ„๋“คํ•œํ…Œ ์•ˆ ๋“คํ‚ค๋ ค๊ณ  ํ˜ผ์ž ์•ฝ ๋จน๊ณ  ๊ฑฐ์‹ค์—์„œ ๋ชจ๋‹ˆํ„ฐ๋งํ•˜๊ณ  ์žˆ์—ˆ๋Š”๋ฐ ์•ฝ ๊ธฐ์šด ๋•Œ๋ฌธ์— ๊ทธ๋ƒฅ ์ž ์ด ๋“  ๊ฑฐ์ง€. ๊ฑฐ์‹ค ์†ŒํŒŒ์—์„œ ์ž ๋“ค์—ˆ์œผ๋‹ˆ๊นŒ ์• ๋“ค์ด ๋ฌธ๋Œ€ ๋ณด๊ณ  โ€˜๋ฌธ๋Œ€๊ฐ€ ๋งŽ์ด ํ”ผ๊ณคํ–ˆ๋‚˜ ๋ณด๋„คโ€™ ํ•˜๋ฉด์„œ ๊ทธ๋ƒฅ ์ง€๋‚˜๊ฐˆ ๋“ฏ...

1ย month ago
42
@takeyourstar_1
@takeyourstar_1
Thread

์—‹๋ฌธ์œผ๋กœ ๋ฌธ๋Œ€๊ฐ€ ์‹ ์žฌํ˜„์—๊ฒŒ ๊ณ ๋ฐฑํ•˜๊ณ  ์‹ ์žฌํ˜„์ด ๊ฑฐ์ ˆํ•˜๋ฉด ๊ทธ ์ดํ›„๋กœ ๋ฌธ๋Œ€ ์—ฐ๋ฝ ๋š ๋Š๊ธธ ๊ฒƒ ๊ฐ™์Œ ์•ˆ๊ทธ๋ž˜๋„ ๊ฑฐ์ ˆ๋‹นํ•ด์„œ ์‹ฌ๋ž€ํ•œ๋ฐ ํ•˜ํ•˜ํ˜ธํ˜ธ ์›ƒ์œผ๋ฉด์„œ ์—ฐ๋ฝํ•  ์‚ฌ๋žŒ์ด ๋ช‡์ด๋‚˜ ์žˆ๊ฒ ์Œ ์‘ ๊ทธ๊ฒŒ ์‹ ์žฌํ˜„์ด์•ผ ์—ฐ๋ฝ ์—†์œผ๋‹ˆ๊นŒ (ํ‰์†Œ์—๋„ ์„œ๋กœ ๊ทธ๋Ÿฐ ๊ฑด ์—†๊ธด ํ–ˆ์Œ) ํ—ˆ์ „ํ•˜๊ณ  ๋ญ”๊ฐ€ ์ด์ƒํ•ด์„œ ํ›„๋ฐฐ๋‹˜ ์—ฐ๋ฝ์ข€ํ•ด์š” ๋ณด๋ƒ„...

1ย month ago
22
@kokonenneS2
@kokonenneS2
Thread

๋ฐ•๋ฌธ๋Œ€ ์ง‘์— ์žˆ์„ ๋•Œ ๋งจ๋ฐœ๋กœ ๋‹ค๋‹ ๊ฒƒ ๊ฐ™์•„ ๊ทผ๋ฐ ๋งจ๋ฐœ๋กœ ๋‹ค๋‹ˆ๋ฉด ์ฑฑ์ฑฑ ์†Œ๋ฆฌ ๋‚จ... ๊ท€์—ฌ์›Œ ๐Ÿป ์•„! ์ง€๊ธˆ ๋‹ค๋ฅธ ๋ฉค๋ฒ„๋“ค์€ ๋ญ ํ•˜๋ƒ๊ณ ์š”? ์ˆ™์†Œ์— ๋ฌธ๋Œ€ ์žˆ๋Š”๋ฐ ๊ทธ๊ฑฐ ์•„์„ธ์š”? ๋ฌธ๋Œ€, ์ฑฑ... ์ฑฑ์ฑฑ์ฑฑ ๐Ÿป ! ์˜ค๋Š˜ ๋ญ ํ–ˆ์–ด์š”, ๋Ÿฌ๋ทฐ์–ด? ์„ธ์ง„์ด๋Š”~ ๋Ÿฌ๋ทฐ์–ด ๋งŒ๋‚˜๊ธฐ ์œ„ํ•ด ์—ด์‹ฌํžˆ ์—ฐ์Šตํ–ˆ๋Š”๋ฐ! ๋‹ฌ์นต ๐Ÿถ ์•„, ๋ฅ์•ฑ ์ค‘์ด์—ˆ๋ƒ....

1ย month ago
47
@anbba_oo
@anbba_oo
Thread

์ฐจ์œ ์ง„์ด๋ž‘ ๋Œ€ํŒ ์‹ธ์šด ๋‚  ํ˜ผ์ž ๋ฐฉ์—์„œ ํ›Œ์ฉ์ด๋˜ ๊น€๋ž˜๋นˆ ๊ฐ‘์ž๊ธฐ ๋‚ด๊ฐ€ ์™œ ์ด๋ ‡๊ฒŒ ์†์ƒํ•ด์•ผ ๋˜๋Š” ๊ฑฐ์ง€ ์‹ถ์–ด์„œ ํ™ง๊น€์— ๋ƒ‰์žฅ๊ณ ์— ๋ฐ•๋ฌธ๋Œ€๊ฐ€ ๊ฟ์ณ๋’€๋˜ ์ˆ˜์ž… ์บ”๋งฅ์ฃผ ๋‘ ์บ” ์›์ƒทํ•จ ๊ทธ ์‹œ๊ฐ ์ฐจ์œ ์ง„ ๋จธ๋ฆฌ ์ข€ ์‹ํž ๊ฒธ ๋ฐ–์—์„œ ์‚ฐ์ฑ…ํ•˜๊ณ  ์žˆ๋Š” ์ค‘...

1ย month ago
26
Advertisement