Linux

48090 readers

929 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Posts must be relevant to operating systems running the Linux kernel. GNU/Linux or otherwise.
No misinformation
No NSFW content
No hate speech, bigotry, etc

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago

MODERATORS

[email protected]

243

Linus Torvalds on the state of Linux today and how AI figures in its future (www.zdnet.com)

submitted 11 months ago by [email protected] to c/[email protected]

40 comments fedilink hide all child comments

At Open Source Summit Japan, Linux and Git creator Linus Torvalds talked about Rust in Linux, Linux maintainer fatigue, and AI's future role in Linux and open-source development.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 7 points 11 months ago* (last edited 11 months ago)

I think that is overly simplistic. Embeddings used for LLMs do definitely include a concept of what things mean and the relationship of things to other things.

E.g., compare the embeddings of Paris, Athens, and London to other cities and they will have small cosine distance between them. Compare France, Greece, and England and same. Then very interestingly, look at Paris - France, Athens - Greece, London - England and you'll find the resulting vectors all align (fundamentally the vector operation seems to account for the relationship "is the capital of"). Then go a step further, compare those vector to Paris - US, Athens - US, London - Canada. You'll see the previous set are not aligned with these nearly as much but these are aligned with each other (relationship being something like "is a smaller city in this countrry, named after a famous city in some other country")

The way attention works there is a whole bunch of semantic meaning baked into embeddings, and by comparing embeddings you can get to pragmatic meaning as well.