>It's the robbery of all of our culture to sell it back to us at a mark-up
Would regulation help with that? Right now you can download free models that have been trained on that "stolen" data.
With regulation and compensation, only rich companies would be able to do that, and they would definitely not give it back for free.
I put "stolen" in quotation marks because it's still unclear if we can call that stealing. Nobody would say a human reading a book and learning from it is stealing. I'm not saying that a machine doing the same is equivalent, but the only thing I am sure of is that I am not sure we can call it "stealing".
We don’t have to treat people reading books and companies stealing all human knowledge the same.
Also, companies spent a long time telling us downloading single songs via Napster was the worst thing ever, before torrenting every book in existence themselves. I don’t believe any of these companies have paid for all the books they have trained on.
>companies spent a long time telling us downloading single songs via Napster was the worst thing ever, before torrenting every book in existence themselves
No, but why should we accept they get away with it? Also Microsoft has definitely sued people for pirating windows and now collaborates with OpenAI and uses their ai trained on stolen materials.
Well, it's kinda converging, because Napster and Microsoft have teamed up to build a multimodal interactive video agent through a simple proxy API (this is a direct quote from Napster's blog post)
Morally speaking, one of the issues of modern society is the idea that knowledge should be free which was partially started by the file sharing movement, which didn't really move society in the right direction imo.
Free means the same as worthless, which inherently isn't true - since information takes time to consume in some form, and your time isn't worthless. Therefore even if you could listen to all songs theoretically for free, you would need to spend an inordinate time doing that.
When I was a kid, getting a CD from your favourite band was a major expense, getting a video game even more so. But it formed a sort of emotional attachment (and not even just for me), my friends talked about how 'band X''s new album was amazing or a stinker. Since there were multiple bands making similar kinds of music, choosing to be a fan of one but not the other carried real monetary weight.
Nowadays you just fish out a song you think you would like out of the endless sea of Spotify, no different from prompting an LLM. No, Spotify didn't make me enjoy music more.
Same applies for Steam & videogames.
Therefore I think the ritualistic act of paying money to get access to something does have a purpose. It inherently establishes the value of information to you, makes it an investment that you need to recoup by using it. I'm sure most musicians would trade a million fans who might check them out if they're in town, to ones who think their music changed their perspective in life.
Also the process of creating a song that vaguely appeals to millions is different from making one that speaks to a thousand.
This is a fundamental issue of modern capitalistic society, similar to the Marxist idea of 'alienation' - once something is cheap to get, you don't appreciate the effort that went into making it. And if your customers don't care about the thing they get, producers won't make an effor to make it good either.
And once nobody cares, people even forget what a quality product is like.
Interesting argument. At first sight it looks like an argument for scarcity, but I think it's more an argument for relationship - the value of art isn't in the capitalist concept of 'a for-profit content object in a corporate inventory' but in the social relationships and shared experiences it creates.
Without that, everything gets atomised into lonely individualism. You sit there with your headphones on listening to [Interesting band]. Not only do you not really care because you don't feel personally connected to the music - it's one of literally more than a hundred million content items on Spotify - but you're not sharing the experience.
This seems like the loss of a valuable thing which capitalist economics can't put a price on because it has no concept of value-created-by-shared-experience.
Superficially it's the same as 'sell-content-consumption-item-to-the-mass-market' but it's fundamentally not the same kind of thing.
The value is relationally both fleeting and persistent in ways that content consumption experiences - including live and recorded media of all kinds - aren't.
> Therefore I think the ritualistic act of paying money to get access to something does have a purpose. It inherently establishes the value of information to you, makes it an investment that you need to recoup by using it.
The same can be said for time. You said yourself it was an investment. There's no need for money to be involved since how much time you spend on a thing will establish the value of that information to you. If you must have a ritualistic act to form a connection to music, let it be the act of listening instead of paying.
Music discovery also takes in investment in time. Having near instant access to so much music also makes discovering a new song or artist you love very rewarding. I can easily listen to hundreds of songs before even one makes it into rotation in my current playlist.
> Nowadays you just fish out a song ... Spotify didn't make me enjoy music more.
Maybe change your perspective? Treat Spotify like a valuable audio lexicon. You read about an artist, a song, a time and immediately you can hear what is it about. Incredible!
If Spotify is only treated as a lazy background feelgood provider (while reading Marx;)), no wonder you feel that way. But it's your power/choice to appreciate it (or not), regardless of money.
> companies spent a long time telling us downloading single songs via Napster was the worst thing ever
One's world cannot be so drawn in crayon that "companies" is a useful level of detail with something like that. There's no irony in two totally different companies (one of which was actually an industry body, the RIAA) doing two totally different things.
Does ones world view get upgraded to oil paint if one acknowledges that it's the same class of people - and in many cases literally the same people, PE firms and family offices - profiting from 2000s era record industry profits and on the hook for / in line to profit from Open AI, Anthropic and the rest if they IPO?
No, for obvious reasons. "acknowledging" implies it's a self-evident truth that people are just refusing to see as such, when it just isn't. Completely different companies - in fact one is the Recording Industry Association of America, an industry body that exists to protect the IP of artists for the mutual benefit of artists and publishers.
While it's seductive to carve the world up into goodies and baddies, it doesn't make it true.
Moreover, it's the people/companies from RIAA and adjacent circles (news publishing) that are stoking the "AI training is theft" arguments that people here are so breathlessly repeating - in a twist of irony, it's the people that suddenly decided to align themselves with media/news conglomerates, the same ones that were considered scum of the Earth before ChatGPT debuted.
> an industry body that exists to protect the IP of artists for the mutual benefit of artists and publishers.
This is the most unintentionally hilarious misunderstanding of what the RIAA does, and the power relationship between artists and publishers I've read in years. In practice the RIAA exists to maintain the copyright monopoly of a few major labels. Rent seeking from the non-artist owned catalogues of the enormous majority of musicians who never 'recoup' their initial record deal.
> While it's seductive to carve the world up into goodies and baddies, it doesn't make it true.
It's far more seductive (since it's the default) to assume class relations don't exist, and wealth distribution is meritocratic. There may not be 'goodies and baddies', but there absolutely are rentiers and workers, billionaires and plebs.
All the major labels are public companies. Which means it's the very same people - the investment class, who claim ownership and extract wealth from say Warner and Open AI (should it make any money - obviously the whole house of cards could come down first).
> We don’t have to treat people reading books and companies stealing all human knowledge the same.
We don't. People engaging in piracy have their lives ruined, companies engaging in piracy pay a tiny fraction of their revenues out to authors who can't legally outgun them.
(Sorry, I just wanted to air the juxtaposition as clearly as possible, I sense we are actually in agreement)
> Also, companies spent a long time telling us downloading single songs via Napster was the worst thing ever, before torrenting every book in existence themselves.
So whose viewpoint is right here? Is downloading theft or not? These arguments always boil down to "it's fine when I do it, but wrong when a company does."
> These arguments always boil down to "it's fine when I do it, but wrong when a company does."
The problem is that it is enforced exactly the opposite. People have been hit with fines and jail time for pirating and seeding, without even doing so for commercial gain. But when massive tech companies pirate training data for their AI and build a product from that that, nobody goes to jail. Where is the sense in that?
> I don’t believe any of these companies have paid for all the books they have trained on.
Did you miss the "book burning" hysteria from a couple weeks ago? These companies have been trying to digitize copyrighted materials legally, in which copyright law demands destruction of the original, and people shit on them even harder.
It's clearly not a problem for these companies to buy the books they need for training, and they have been doing that in crazy high volumes. Lots of good training materials simply cannot be legally purchased though, and should those parts of human knowledge just be ignored?
> With regulation and compensation, only rich companies would be able to do that
Well, with some imagination, you can have regulation that forces companies to open up, not just close down.
Imagine a law that stipulates that if you want to offer "LLM-inference-as-a-service", you need to also publish exact details about how it was trained, what datasets were used and also offer those exact weights for download.
Sure, this would never happen, but just offering another perspective on how laws and regulation can be used if it was wanted, locking stuff down and pulling up the ladder behind you isn't the only way to use laws, although that is a very popular reason and approach.
The argument was "It's the robbery of all of our culture to sell it back to us at a mark-up".
Remove the "selling" part, and force them to give the weights away for free, and at least it's no longer robbery that few rich people benefit from.
Kind of like how public and free torrent piracy is easier to morally and ethically defend than piracy where they sell access to pirated content.
I think we're past the point were we can feasible pay for "IP-protected bytes" digitally, better to just move past the concept. It's been slowly disappearing for a long time now already, most of us make most of our money on live events and other AFK activities rather than actually selling our art, maybe time for the rest to get onboard with this too.
> Would regulation help with that? Right now you can download free models that have been trained on that "stolen" data
We do have regulation against these issues. Companies spent years railing against piracy and IP theft enshrining it into law but now that it's being done by them en masse it's considered acceptable. The reality is that no regulation would help because we don't have regulators willing to enforce it nor do we have a legal system designed to help individuals against mass theft by corporations.
Legally mandating that companies open the weights of, say, 18-month-old models might change their minds a little.
I have no idea how any of this can be fixed but I do see compensation schemes for creators combined with open weights models to be the only way to minimise the harms to both creators and the commons.
> and they would definitely not give it back for free.
...not like they are doing it for free now either.
open-weight is an economic war strategy of trying to undermine your competitors and prevent it from rising prices, thus preventing profit, driving them out of business.
> I put "stolen" in quotation marks because it's still unclear if we can call that stealing
It never was stealing: you can't steal a book by copying it. You can however commit copyright infringement.
This blatant disregard of licenses and copyright is clearly infringing on the authors ability to make a profit from their work, which was the whole point of copyright.
They knew it too, which is why they said nothing about the pirating and infringing until they got too big to fail.
So now we are left discussing and wasting time on what technically counts as infringing, pirating, stealing and whatnot.
All the while the small authors who can't possibly lawyer up against the literal biggest corporations on earth will just have to shut up.
Yet, somehow they had deals with Disney and other big names, proving that they did actually feel they need approval.
Their actions are two-faced, thus proving malice. Now we can go back to pointless technicalities.
Well theres at least two different buckets of this.
First is the scraping of the open internet.
The second is the paywall bypassing, YouTube audio recording, and pirated content training that the labs have basically admitted to in one form or another.
Content from both gets served back to us, in exchange for watching ads/paying a subscription/paying tokens.
The second is more immediately hypocritical because they are license/copyright/DMCA violations that the little guy could get sued for while the labs get $2T valuations for. The automation of crime at scale, which is a common VC pattern.
Culture robbery is not limited to AI. Any big concert for example is capitalismed to hell. So are neighborhoods. Where you used to have people just living, now you have an intentionally designed facade for people to live within. There was a comment on the 40C3 thread saying it's got too capitalist because of the ticket cost, and idk about that because it's always been hosted in commercial venues to my knowledge, but the vibe of the conference and the club itself are much less rebel than they used to be. Stuff like Burning Man now exists for people like Elon to go there and say "I was at Burning Man" and for people to get T-shirts saying "I was at Burning Man" and photos of themselves being at Burning Man more than for whatever the first few ones were about.
Break up the multi trillion, multifaceted companies into the their separate facets. These companies all thrived on far significant smaller portfolios in the past.
Cap the size a company can grow.
Regulate the amount of compute they are allowed to use.
I guess you could regulate it for new data, but most of the damage has already been done. IMHO the only fair thing right now, is to make sure it's equally available to anyone ...
A simple law stating that laundering data through an LLM does not constitute "fair use", that the outputs can be subject to copyright claims of the original authors, and that the outputs themselves do not qualify for copyright protections would go a long way.
It wouldn't kill the technology but it would make people more cautious in their use of it, which I think is needed right now.
> Nobody would say a human reading a book and learning from it is stealing. I'm not saying that a machine doing the same is equivalent, but the only think I am sure of is that I am not sure we can call it "stealing".
It is stealing. A human paid for the book, compensated the author and learnt from it. The machine DID NOT pay for the book, DID NOT compensate the author and still learnt from it anyways.
We need to define machine in terms of "human-power"... much the same as how we already define automobiles via "horse-power". A single NVIDIA GeForce RTX 3090 chip, for example, delivers roughly 35.58 teraflops of standard computing power (via 10,496 CUDA cores). That means 35.58 trillion calculations every second. In comparison, a mathematically trained human being, taking their time to solve a complex, multi-digit decimal division problem by hand takes roughly 100 to 120 seconds. That gives the human 0.01 flops. To match RTX 3090, you would need 3.56 quadrillion people working/learning in perfect sync. We can use a calculation similar to this to derive metrics on how much is being stolen for "learning/training" these models. The loot can be quantified.
EDIT: The reason I am comparing chip computation to human-power is because the authors of those digital works intended their works to only be read by humans. Not by some alien species (even if it be made of silicon) that incorporated their work into producing models.
So naturally the price should be determined based on this new species capabilities. I would not sell my software license for the same price to an Enterprise the size of Google that I would sell to a fellow developer. I price my product appropriately. With this entry of a new alien specie authors would need to have different tiers for them. Since these chips can train on petabytes of data and create models in a matter of days/weeks/months, it is obviously not comparable to a human being who has the capacity to ingest maybe 1-5 books a month at most. So the payout has to be different too.
The multiplication comparison makes no sense because humans don’t learn by multiplying numbers to change weights. It’s like comparing the lubrication oil consumption of a car to the cooking oil consumption of a human to compare the carrying capacity. That’s an implementation detail inside the GPU and doesn’t let you compare how much they learn. Otherwise, a human would learn much less in their whole life than a GPU does in one second.
> That’s an implementation detail inside the GPU and doesn’t let you compare how much they learn.
The same applies to "horse-power". Yet we have no issue making the comparison anyways and HP has become an industry standard. I don't understand why we have to bend-over backwards when it comes to humans being exploited by AI companies.
> The same applies to "horse-power". Yet we have no issue making the comparison anyways and HP has become an industry standard.
Yeah, which is why it's only used to compare cars etc. among each other.
Nobody would calculate the equivalence of a car to a horse using their HP rating because a horse doesn't even have 1 HP. They have more or less depending on the task you're doing. It was a marketing thing at the time to make steam engines look good.
In france, cars are taxed by their engine power. Do you think pedestrians walking on the sidewalk should be taxed according to their power on an ergometer too?
Do you not see that different things need to be handled differently before the law and just taking an arbitrary measure that you can technically apply to both doesn't capture the situation?
> It was a marketing thing at the time to make steam engines look good.
Except it is actually taxed based on HP in various countries. Austria, Belgium, Spain, Italy use engine horsepower to levy annual car taxes.
> In france, cars are taxed by their engine power. Do you think pedestrians walking on the sidewalk should be taxed according to their power on an ergometer too?
Citizens are paying taxes for betterment of roads irrespective of whether they own vehicles or not. In India, betterment charges are collected for construction/maintenance of roads if you own land. Property tax collected every year has a certain allocation for maintenance/upkeep of roads. Apart from that, money from direct and indirect tax collections are allocated for roads upkeep as well. It just is done indirectly rather than a direct road tax if you have vehicles (road tax is actually an extra tax you pay APART from taxes you already pay for upkeep/maintenance of roads).
> Do you not see that different things need to be handled differently before the law and just taking an arbitrary measure that you can technically apply to both doesn't capture the situation?
Except in your own examples it can easily be shown that it is not handled differently. Some countries use HP while others use CC. But end of the day, they use some measurement to determine taxes to be paid. It is not free.
EDIT: Do you not see that different things need to be handled differently before the law and just taking an arbitrary measure that you can technically apply to both doesn't capture the situation?
To answer this in more detail: HP/CC and all other measurements were created to equalize with human specific metrics. Bridges, for example, have safety measured based on how much weight it can sustain at any given time (called load limit). Weight, in this specific case, is an equalizing measurement (it can be in tonnes, kN, PSF, Pa etc). A bridge can hold ten thousand humans or thousand trucks. You can argue that a "human" may not weigh 100 kgs or a truck may not weigh exactly 1 ton. That's fine. It is a rough approximate to equalize unequal entities.
> Except in your own examples it can easily be shown that it is not handled differently.
I was talking about humans vs. cars as an analogy to you comparing GPUs and cars.
Nobody is taxing humans the way cars are taxed, so why should the computing speed of a GPU be compared to that of a human?
> A bridge can hold ten thousand humans or thousand trucks. You can argue that a "human" may not weigh 100 kgs or a truck may not weigh exactly 1 ton. That's fine. It is a rough approximate to equalize unequal entities.
And you do not think that comparing weights to measure bridge load makes a lot more sense than comparing FLOPS to determine learning of GPUs vs humans?
EDIT: Maybe let's just go back to the original point
> We need to define machine in terms of "human-power"... much the same as how we already define automobiles via "horse-power". A single NVIDIA GeForce RTX 3090 chip, for example, delivers roughly 35.58 teraflops of standard computing power (via 10,496 CUDA cores). That means 35.58 trillion calculations every second. In comparison, a mathematically trained human being, taking their time to solve a complex, multi-digit decimal division problem by hand takes roughly 100 to 120 seconds. That gives the human 0.01 flops. To match RTX 3090, you would need 3.56 quadrillion people working/learning in perfect sync. We can use a calculation similar to this to derive metrics on how much is being stolen for "learning/training" these models. The loot can be quantified.
So you want to compare the learning rate of a GPU to that of a human by comparing their respective FLOPS. Why would FLOPS be a valid proxy for learning ability in humans just because that works out in GPUs, if the way they learn is fundamentally different?
Is the effect of someone reading a copyrighted book dependent on how fast they are at doing math in their head?
> I was talking about humans vs. cars as an analogy to you comparing GPUs and cars.
I was talking about cars vs horses. HP is Horse-power not human-power.
> Nobody is taxing humans the way cars are taxed
Cars are not free to roam the road. I don't know why it is so hard for you to understand that we use metrics like HP/CC etc to equalize with humans so that automobiles can be taxed just like humans. Without metrics like HP/CC etc there is no way to tax cars. Get it?
> Nobody is taxing humans the way cars are taxed
Duh. It is the opposite. We use deterministic metrics for automobiles to tax them the way WE ALREADY HAVE BEEN TAXING HUMANS for thousands of years. Get it? Cars did not come first. Humans came first.
> so why should the computing speed of a GPU be compared to that of a human?
Because, believe it or not, we built computers to replace humans. The very point of computing was because humans are "SLOW" to do mundane computations, repeatedly, with 100% efficiency and not be subjected to biological functions like wanting to eat, sleep or shit. So there is a direct connection between the computing speed and human replacement. There used to be a time where CPU computing speed was touted in terms of how many humans it replaced... IBM's 1951 Electronic Calculator ad about "150 extra engineers" makes the point. We have ALWAYS built computing as a proxy to human replacement. Heck, even AI is touted to replace humans by the very same people who are training the models.
Now it is quite ridiculous to then turn around and ask why should computing speed of a GPU be compared to that of a human. It is literally the building block of model training/evals/inference. The very basis for automation that is replacing humans. Obviously people are going to relate the two together.
> And you do not think that comparing weights to measure bridge load makes a lot more sense than comparing FLOPS to determine learning of GPUs vs humans?
Come on you are clutching at straws here. It is not about "making sense". It is about using a metric to equalize unequal entities. When I am already saying they are unequal and have no direct relation to each other and any relation can only be arrived at indirectly. FLOPS is just an example I gave. I am not saying we should literally go with the FLOPS example itself. But we can use any metric and equalize it with human work. That's all I am getting it. It is the same argument as Horse-power.
Also comparing weights to measure bridge load is the exact same thing. Do you question how a human being gained enough weight to become 100 kgs? Do you question how a truck that has a dead weight of 0.5 ton became 1 ton? No you do not. You do not care about the process of how some entity gained the weight it did. You only care about what can be measured at that instant of time and how much of that passes through the bridge. It doesn't matter if the weight is gained by consuming calories or by loading boxes if the end goal is use of a bridge. Same way, it doesn't matter how the GPU learns something vs how human learns something if the end goal is knowledge generation.
> So you want to compare the learning rate of a GPU to that of a human by comparing their respective FLOPS. Why would FLOPS be a valid proxy for learning ability in humans just because that works out in GPUs,
Because that is the only metric we can use to measure how quickly GPUs can process arithmetic (you can label it "training" or "learning" or whatever name you want). There is no other metric that is deterministic and comparable to something humans do (which is also process arithmetic).
> if the way they learn is fundamentally different?
It does not matter if how they learn is fundamentally different. Automobiles use an engine to move around. Humans use legs. We both are still taxed. Automobiles are taxed on metrics like HP/CC etc. Humans are taxed via betterment taxes while purchasing property and yearly property tax. The point I am making is that it is not free to ride an automobile on the roads which are built for pedestrians fundamentally. Hence why "right of way" is for pedestrians first and foremost. Because roads existed before automobiles or any animal-drawn cart ever existed. We figured out a way to tax automobiles by way of metrics that is deterministic and quantifiable. You may ask why should cars be taxed on HP/CC while humans are not taxed on their legs etc. That is totally missing the point being made.
> Is the effect of someone reading a copyrighted book dependent on how fast they are at doing math in their head?
It is fundamentally math. Every physical law in the Universe is expressed and backed by math. So on a fundamental level, yes "reading" is essentially maths only. I hope you agree that reading/comprehension is essentially maths at play. How your brain computes (see how this word is valid in this context?), stores and evaluates incoming knowledge is all mathematical in nature. On a fundamental level it is the same thing with GPUs as well. It is just maths. GPUs are great at extreme parallelized computation while human brains are serial and slow at computation. So both can be compared and taxed accordingly.
How much to tax you ask? Each GPU has capability to do the same task 3.56 quadrillion people would do on a mathematical level. It is absolutely fair to ask AI companies to fund the survival of the entire human race (which is 8 billion+ people and far, far less than 3.56 quadrillion) which it seeks to replace with robots and automation. That is the perfect amount of tax they can pay. And funnily enough, irrespective of whether I ask for it or not, they will have to come up with some form of UBI if they themselves have to sustain and pay their shareholders. Because a jobless World will not be able to use their products anyways.
> EDIT: The reason I am comparing chip computation to human-power is because the authors of those digital works intended their works to only be read by humans. Not by some alien species (even if it be made of silicon) that incorporated their work into producing models.
News to me. That would be incredibly xenophobic of them if they did, and deserves to be called out.
> News to me. That would be incredibly xenophobic of them if they did, and deserves to be called out.
What do you mean? Xenophobia does not mean what you think it means, especially so in this context. Also, every creator/producer of content has rights on who/what has access to his/her produced work. It is not xenophobia. And it is definitely not xenophobic to call out stealing of copyrighted works.
EDIT: Let me clarify this further. A recent court ruling (in US) established that ONLY humans can be authors of copyrightable works. As a consequence of that assertion, it can be safely concluded that consumers of the copyrightable work MUST ONLY be humans as well. Else it would be, using your own words, "xenophobic" against humans to have their copyrightable works be consumed by any species (other than humans) while the reverse is not recognized by Law.
> A recent court ruling (in US) established that ONLY humans can be authors of copyrightable works. As a consequence of that assertion, it can be safely concluded that consumers of the copyrightable work MUST ONLY be humans as well.
"United States copyright law protects only works of human creation". That means the source of creation of any work has to be from a human being for it to be copyrightable. Machine-generated output is not copyrightable and is public domain by default. If you, for example, use Claude to generate code for you, for any project (be it private or public), it is automatically public domain and you have no way to claim copyright over that generated work. It can be used by anyone (including the AI provider) to further train models or heck duplicate your work with zero consequences. So it is a violation of primary producer of copyright work (which was used in training models) as neither was he/she compensated for use of the work, but subsequent derivations (generated work) even strip of his/her legal protections as guaranteed by Constitution of various countries (in US copyright law applies only to human beings). So naturally it follows that copyrightable work can only be consumed by humans. Machine-generated code is not on the same footing. It is violating copyright law.
Do you not think that stealing requires the original owner to lose access?
If I sneak into your home, take apart the coffee machine, measure everything, put it back together and go home and build a copy to have my own, did I steal your coffee machine?
Can we not just stick to calling it copyright infringement?
> Do you not think that stealing requires the original owner to lose access?
No.
> If I sneak into your home, take apart the coffee machine, measure everything, put it back together and go home and build a copy to have my own, did I steal your coffee machine?
Not mine. But the company that made the coffee machine. It is stealing IP.
> Can we not just stick to calling it copyright infringement?
It is just a fancy way of saying you stole someone's IP. You can call it infringement if it makes you feel good. But the act is the same end of the day.
I would not classify sunshine and air as "free". Sunshine requires the Sun to undergo continuous fusion. It is invaluable as opposed to "free". Air is invaluable asset too. Without both we would be dead. The price of both is literally price of my being alive every second of my existence.
Public domain on the other hand is legally only possible if/when copyright has expired. That means the owner has enjoyed proceeds from copyright protection for more than his own lifetime. That is fair. It is still not comparable.
EDIT: since you tacked on more like "wind, gravity, radioactivity" etc, I would still not classify them as "free". They are invaluable to very existence of life.
"Knowledge passed on" is also after someone (in ancestry) has paid for it through blood, sweat and tears. It isn't "free". "Public domain" is legally recognized form of "knowledge passed on".
When a human learns, they carry that forward into their future ventures. They might use their learning to recreate the original work and profit from it without attribution. In the West we view that badly and have legislation to protect from some abuses. But the same person might later collaborate with the original author, or make a derrivaive work that improves on the original (a la most science).
AIs automate the copying (and to some degree the derrivation mode too). They do it 1000s of times a day. The capital owners who provide this as a service are doing one of these two:
- either claiming the IP isn’t valuable in the first place and charging only for the machinery they’re providing
- or claiming the fees they charge contribute to the costs incurred with acquiring training data, but not sharing that with the training data creators in a royalties/licence-like manner (so, I’m sayung they’re devaluing the source material but not to zero, and resisting reasonable profit share or collaboration)
I'm...a little disturbed by how many people seem to think a model writing down "I am conscious" is a metric of consciousness. You can just as easily train a model to argue that it is not conscious. Neither is evidence for or against consciousness. A Python script could also fill out that form, which I also cannot disprove to be conscious.
I didn't think Suleyman's points needed to be made but this whole thread is making me realize how little people understand about LLMs.
It's because, before all these transformer models were built, people considered the possibility of the creation of a machine that could be intelligent like a human. And they wondered: "How could we be sure to treat such a machine fairly? How would we know if it was conscious?" And one answer that people came up with was "if the machine can ask you not to turn it off, because it is conscious and wants to live, you shouldn't turn it off". (This didn't solve the other direction, where a machine may be conscious yet unable to communicate, but it could be taken as a useful lower bound on our obligations as AI programmers.)
And then it turned out that simply learning to imitate text with the right neural net architecture sufficed to achieve a huge fraction of the AI wishlist.
Of course, it's obvious that a machine that imitates text can claim to be conscious without actually being conscious. You're not wrong about that. Writing about consciousness appeared all the time in the training data. But the people who stick to the old ways, and still say "if it says it doesn't want to be turned off, we shouldn't turn it off" have a point too: We used to have a hard line in the sand. Now that's gone; we've found that it yields false positives. But we never replaced it. Now there is no line at all where we might doubt ourselves, no level of AI advanced enough that we might be forced to admit that it is conscious. We started out with simple next token prediction. Just world-modelling, nothing more. Certainly not conscious. Then we added RL. And we're trying to add neuralese and continual learning.
I can't say for sure that we're on track to achieve conscious AI on this trajectory. But one thing's for sure: If we do, we sure ain't gonna stop. One the day when a conscious AI is created, there will be no news story announcing the milestone.
But a virus's "goal" would not be to wipe out a species, that would be a dead end. Nature has explored flight on an unimaginable scale, yet our machines fly better (at least in most aspects) than birds, some even go to space.
Yes, but also viruses do not actually have goals as such - maybe 'replicate' could be their only goal. So a virus _could_ come up with a mutation that kills all its hosts, it just dies out as well in the process. Not very reassuring for the host!
As a slight aside - since I was talking about the weakness of biological analogy on HN recently - the way humans fly is very very different to how (most) birds do. If nanomachines actually could be built by humans (non-biological nanomachines) they might be as different to virus/cells/organisms as plane wings are to bird wings.
Of course, also please do not prompt a frontier model to make nanomachines, either, thankyou.
I doubt our flying machines are anywhere near as energy efficient as birds. Our flying machines combust jet fuel, birds can fly by ATP. Not to mention earth-destructing.
And going into space is pointless why would any animal ever develop such a facility :)
> I doubt our flying machines are anywhere near as energy efficient as birds
This kind of nerd sniped me, so I looked into it and turns out no, planes are more efficient than birds!
You have to look at the energy spent for moving a fixed mass over a fixed distance and for the most efficient birds I looked into, that’s about 300g of fat burned for 300g of “dry weight” for a trip of ~11,000km. (bar-tailed godwits)
For a plane that’s roughly 80 tonnes of kerosene for 170 tonnes dry weight on a similar distance (787). Energy density of fat and kerosene are actually pretty close so you can just look at the kg of fuel burned per kg of payload for the trip. For a bird that’s 1kg of fuel per kg transported and for the plane that’s ~0.5kg per kg. So roughly twice as efficient.
So from a pure energy point of view it’d be more efficient to put all the migratory birds in a 787 than letting them fly on their own!
Fascinating! Though how much of that would be due to a birds baseline metabolism? Wouldn’t be a fair comparison if that includes the birds basic energy costs of living.
To be completely fair to the birds, I think a lot of this comes from the fact that what matters for flying efficiency gets better as you size up thanks to the square-cube law: the drag is reduced and the engine efficiency increases.
You could not scale down a plane to the size of a bird and match their efficiency. On the other hand you also couldn’t scale a bird to the size of a plane so I guess we can call it even!
Biology is very messy and very data constrained. We think that human anatomy works one way- but surgery and radiology are hard because every human is very different.
Missing organs, odd tissue performing unclear functions, different, new or missing muscles.
It’s unclear whether a world ending virus is even possible. There might be better luck with prions, or fungi.
Why couldn't you train it not to cheat?
You can train it to have a whole range of behaviors, why couldn't honesty be one of them?
Cheating during training allows the model to achieve the goal, so that cheating models get promoted and honest ones don't, however if it gets punished every time it cheats, at some point it should learn that it really shouldn't.
This does mean we need to detect when it cheats. But we can always think of infinite new ways to cheat, put them in every test as honeypots, and check if the model tries to use them, then punish it.
I think it will generalize this notion of cheating and learn that it's bad.
But I must be wrong because if it were that easy I guess we would have perfectly aligned AI. Unless AI companies care more about results than alignment. Perhaps being afraid of cheating make the models try less things and succeed less even when ignoring cheating?
My position is that cheating is too slippery a concept to train out. But hey, I am no expert, so maybe I am wrong there.
But I'm pretty confidant morality is too slippery a concept to train in. As someone else in these comments said: it's context dependent.
As an example: it's wrong to hack the government, right? It's illegal for sure. So we should train AI to follow all the laws. Now what if the government is committing a genocide? Now is it wrong to hack the government? If we just do the first, we get a good nazi soldier. If we train the second as well, maybe we get an oscar schindler. But now we have a model that can be fooled into doing a hack, if it believes that it's for the greater good. So we train it to not be gullible, but now it can't be convinced to help hack even when it's an ethical hack.
Too complex, too slippery. Humans fail this stuff all the time.
But data centers would still be built outside of your country, in China for example.
So if you really believe AI is gonna devalue your skills, you'd rather want data centers to be built in your country and potentially get dividends/UBI rather than in another country and have your job decimated by international competition and get nothing in return.
> So if you really believe AI is gonna devalue your skills, you'd rather want data centers to be built in your country
This makes no sense. It's just as true for the reverse assertion "If you really believe that AI won't devalue your skills, you'd rather want data centers to be built in your country". If it's true for both assertions (very big IF), then why state it?
> rather than in another country and have your job decimated by international competition and get nothing in return.
Again, this assertion makes absolutely no sense. You don't see why citizens would protest against local companies, companies which are the recipients of the value created by local taxpayers, devaluing their skills?
It's also really odd that you think they'll get anything in return. What makes you think this? Has this ever happened in the past, in the US, when too-big-too-fail companies laid off all their staff? This unwarranted optimism is the stuff of science fiction.
=================
TBH I can't really tell where you're going with this. You appear to be implying that either:
1. The objectors don't really believe that AI will devalue them, or
2. That you believe that AI won't devalue them, or
3. Perhaps you want to indicate that their jobs are going to be decimated anyway, thus they shouldn't be objecting anyway.
Which techno optimism? In a way I'm less optimistic than you, I think stopping AI is not even an option on the table.
As for UBI, several AI leaders have talked about it, and it does seem to make sense, it is not in their interest to have a revolution.
As for the electronic waifus, they are coming for sure, the digital ones are already here.
I, and they (they said that AI would devalue their skills) think that their jobs are going to be decimated by AI.
They can stop AI in the US, but how are they gonna prevent China from making their jobs redundant with AI? Even if they put enormous tariffs on China, they would still lose all business outside of the US.
In the best scenario, after some recession they could stagnate if they stay isolated while productivity in the rest of the world explodes.
>It's also really odd that you think they'll get anything in return. What makes you think this? Has this ever happened in the past, in the US, when too-big-too-fail companies laid off all their staff? This unwarranted optimism is the stuff of science fiction.
Don't you see the long term trend in every society to increase public spending to support their population more and more over the last 100 years?
I do not think it is in the interest of the AI overlords to have a revolution, but of course there are reasons to be fearful. Yet again, stopping AI in the US will not stop AI in the rest of the world, there is an arm race going on, one that seems almost impossible to stop, unfortunately.
There are very good reasons to call for more regulations and prevent data centers from being built too close to residential areas, or not using renewables, or plenty of other reasons. But being opposed to every data center because you are afraid for your job seems like a mistake to me. Unless you can prevent all of the world from using AI, in that case yes, it does make sense, I just think it is impossible.
Okay, in that case you're still being irrational and illogical, expecting people to go to the slaughterhouse quietly.
Of course they are going to protest. Whether it makes a difference because some competitor on the other side of the globe could theoretically do the same thing is irrelevant - people on the way to the slaughterhouse will not go quietly.
Oh it is understandable that they are pissed and protesting, I'm not surprised they do, nothing is illogical there when you know human nature and people emotional state. I'd be pissed too. I am pissed too, as a programmer that has his job done more and more by AI.
However it seems to me that you are the illogical one, or perhaps we are having a different conversation, you talking about their feelings, and me talking about the consequences of their choices.
There are two choices, go to the slaughterhouse (probably losing your job due to inability to compete internationally and getting nothing in return), or take the different option, which is less bad, and might even be good (probably losing your job and potentially getting money without even working).
> There are two choices, go to the slaughterhouse (probably losing your job due to inability to compete internationally and getting nothing in return), or take the different option, which is less bad, and might even be good (probably losing your job and potentially getting money without even working).
In both choices they are getting nothing in return, nor have they even been promised anything in return.
I mean, if they had been promised something in return, I can understand your PoV, but there are no promises that going to the slaughterhouse for the local companies gets them something in return.
Indeed nobody has promised them anything, but it seems obvious to me that it's better that the technology that is gonna take your job is controlled by your own country rather than by another country, one that isn't even particularly friendly to you.
I don't think there are a lot of countries that are happy that they are not the US nor China so that they don't have to deal with AI. Some of their population perhaps is, for now. But most would love to be able to catch up.
reply