Creating a specialized neural net to perform a specific function is cool. Slapping GPT into customer support because you like money is horse shit and I hope your company collapses. But yeah you're right. Blockchain was a solution with basically no problems to fix. Neural nets are a tool that can do a ton of things, but everyone is content to use them as a hammer.
I'm not even understanding what AI is at this point because there's no delineation between moderately sophisticated algorithms and things that are orders of magnitude more complex.
I mean, if something like multisampling came out today we'd all know how it'd be marketed
Yes. But companies bought into AI way more than they bought into crypto though, in many outlandish and stupid ways. And many AI companies sell it in ways they shouldn't.
Blockchain has many valuable uses. A distributed zero trust ledger is useful. Sadly the finance scammers and the digital beanie baby collectors attracted all the marketing money.
I think all the crypto scams, all the shitcoins, NFTs and other blockchain bullshit were much worse. At least AI companies usually don't require you to give them large sums of money, they're only after your data and absolutely fuck the environment by wasting absurd amounts of power, but they don't try to take away your life savings
As a major locally-hosted AI proponent, aka a kind of AI fan, absolutely. I'd wager it's even worse than crypto, and I hate crypto.
What I'm kinda hoping happens is that bitnet takes off in the next few months/years, and that running a very smart model on a phone or desktop takes milliwatts... Who's gonna buy into Sam Altman $7 trillion cloud scheme to burn the Earth when anyone can run models offline on their phones, instead of hitting APIs running on multi-kilowatt servers?
And ironically it may be a Chinese company like Alibaba that pops the bubble, lol.
I am old enough to remember when the CEO of Nortel Networks got crucified by Wall Street for saying in a press conference that the telecom/internet/carrier boom was a bubble, and the fundamentals weren't there (who is going to pay for long distance anymore when calls are free over the internet? where are the carriers-- Nortel's customers-- going to get their income from?). And 4 years later Nortel ceased to exist. Cisco crashed too, though had enough TCP/IP router biz and enterprise sales to keep them alive even until today.
This all reminds me of the late 1990s internet bubble rather than the more recent crypto bubble. We'll all still be using ML models for all kinds of things more or less forever from now on, but it won't be this idiotic hype cycle and overvaluation anymore after the crash.
Shit, crypto isn't going anywhere either, it's a permanent fixture now, Wall Street bought into it and you can buy crypto ETFs from your stockbroker. We just don't have to listen to hype about it anymore.
We just don’t have to listen to the hype about it anymore.
True, it’s now in most circles just been mixed in as a commodity to trade on. Though I wish everyone would get that. There’s still plenty of idiots with .eth usernames who think there’s some new boon to be made. The only “apps” built on crypto networks were and are purely for trading crypto, I’ve never seen any real tangible benefit to society come out of it. It’s still used plenty for money laundering, but regulators are (slowly) catching up. And it’s still by far the easiest way to demonstrate what happens to unregulated markets.
Crypto has been turned into gold by wallstreet, they bought up enough of it to jot be completely exposed, it's supply is extremely limited and will run out. Putting your money into it is no different than putting it into gold, you might catch a good moment and buy in low and get some return, but most wont.
I went to a AI conference and you can just sense how bogus it all feels. Like "Our patent pending AI system references billions of crowd-sourced data points to identify what you are craving for breakfast! Never think about breakfast again!"
And as a engineer speaking with other engineers, we all collectively shrug and just keep taking the money. I'll AI your toaster for enough money IDGAF.
Like all new technologies, there is a time when bunches of companies jump on the band wagon to get in on the action. You can see it all throughout the history of the industrial revolution.
They mostly know that there will come a great weeding out of those that can't handle the technology or just fail from poor management. But they are betting they will be among the 1% that wins the race and remain to dominate the market.
The rest will just bide their time until the next Big Thing comes along. And the process starts over again.
Yeah, but thanks to the glory of corporateworld, all the people involved in making these decisions will be in a higher position at a different company by the time the consequences come knocking.
You definitely will not regret spending billions of dollars on GPUs and electricity bills.
Maybe it's like the dotcom bubble: there is genuinely useful tech that has recently emerged, but too many companies are trying to jump on the bandwagon.
LLMs do seem genuinely useful to me, but of course they have limitations.
We need to stop viewing it as artificial intelligence. The parts that are worth money are just more advanced versions of machine learning.
Being able to assimilate a few dozen textbooks and pass a bar exam is a neat parlor trick, but it is still just a parlor trick.
Unfortunately probably the biggest thing to come out of it will be the marketing aspect. If they spend enough money to train small models on our wants and likes it will give them tremendous amounts of return.
The key to using it in a financially successful manner is finding problems that fit the bill. Training costs are fairly high, quality content generation is also rather expensive. There are sticky problems around training it from non-free data. Whatever you're going to use it for either needs to have a significant enough advantage to make the cost of training /data worth it.
I still think we're eventually going to see education rise. The existing tools for small content generation adobe's use of it to fill in small areas is leaps and bounds better than the old content aware patches. We've been using it for ages for speech recognition and speech generation. From there it's relatively good at helper roles. Minor application development, copy editing, maybe some VFX generation eventually. Things where you still need a talented individual to oversee it but it can help lessen the workload.
There are lots of places where it's being used where I think it's a particularly poor fit. AI help desk chatbots, IVR scenarios, It says brain dead as the original phone trees and flow charts that we've been following for decades.
If GPT4o is still not what you would call AI, then what is? You can have conversations with it, the Turing test is completely irrelevant all of the sudden.
We're hitting logarithmic scaling with the model trainings. GPT-5 is going to cost 10x more than GPT-4 to train, but are people going to pay $200 / month for the gpt-5 subscription?
Businesses might pay big money for LLMs to do specific tasks. And if chip makers invest more in NPUs then maybe LLMs will become cheaper to train. But I am just speculating because I don't have any special knowledge of this area whatsoever.
10 to 30? Yeah I think it might be a lot longer than that.
Somehow everyone keeps glossing over the fact that you have to have enormous amounts of highly curated data to feed the trainer in order to develop a model.
Curating data for general purposes is incredibly difficult. The big medical research universities have been working on it for at least a decade, and the tools they have developed, while cool, are only useful as tools too a doctor that has learned how to use them. They can speed diagnostics up, they can improve patient outcome. But they cannot replace anything in the medical setting.
The AI we have is like fancy signal processing at best
Not an expert so I might be wrong, but as far as I understand it, those specialised tools you describe are not even AI. It is all machine learning. Maybe to the end user it doesn't matter, but people have this idea of an intelligent machine when its more like brute force information feeding into a model system.
By definition AI (artificial intelligence) is any algorithm by which a computer system automatically adapts to and learns from its input. That definition also covers conventional algorithms that aren't even based on neural nets. Machine learning is a subset of that.
AGI (artifical general intelligence) is the thing you see in movies, people project into their LLM responses and what's driving this bubble. It is the final goal, and means a system being able to perform everything a human can on at least human level. Pretty much all the actual experts agree we're a far shot from such a system.
AI in health and medtech has been around and in the field for ages. However, two persistent challenges make roll out slow-- and they're not going anywhere because of the stakes at hand.
The first is just straight regulatory. Regulators don't have a very good or very consistent working framework to apply to to these technologies, but that's in part due to how vast the field is in terms of application. The second is somewhat related to the first but really is also very market driven, and that is the issue of explainability of outputs. Regulators generally want it of course, but also customers (i.e., doctors) don't just want predictions/detections, but want and need to understand why a model "thinks" what it does. Doing that in a way that does not itself require significant training in the data and computer science underlying the particular model and architecture is often pretty damned hard.
I think it's an enormous oversimplification to say modern AI is just "fancy signal processing" unless all inference, including that done by humans, is also just signal processing. Modern AI applies rules it is given, explicitly or by virtue of complex pattern identification, to inputs to produce outputs according to those "given" rules. Now, what no current AI can really do is synthesize new rules uncoupled from the act of pattern matching. Effectively, a priori reasoning is still out of scope for the most part, but the reality is that that simply is not necessary for an enormous portion of the value proposition of "AI" to be realized.
ChatGPT is an LLM that is a generative pre-trained model using a nueral network.
Aka: it's a chat bot that creates it's responses based on an insane amount of text data. LLMs trace back to the 90s, and I learned about them in college in the late 2000s-2010s. Natural Language Processing was a big contributor, and Google introduced some powerful nueral network tech in 2014-2017.
The reason they "appeared out of nowhere" to the common man is merely marketing.
The tech bros are selling, but it's the VCs that are fueling this whole thing. They're grasping for the next big thing. Mostly they don't care if any of it actually works, as long as they can pump share value and then sell before it collapses.
Yeah, but the 0.1% remaining will take over the world.
Does anyone remember the era when there were a million search engines? Google didn't spawn alone.
Same with Amazon. You think nobody else tried to make an online store in the 90s? Lol.
People are trying to vindicate their dislike of AI, pointing to trends like this as if it were supporting evidence. But saying "AI is going to be a big flop because 99% of companies today will end up failing" is as stupid as saying "online shopping will never work because 99% of online stores will close by the year 2010"
Same with Amazon. You think nobody else tried to make an online store in the 90s? Lol.
Fun fact: the first online store still exists. It's Pizza Hut. They launched an experiment for online ordering in 1994. The first company to ever sell a product on the web.
Yum brands has always been at the forefront of using tech to sell fast food. This was true then and is true now. Taco Bell has pioneered kiosks and in-app ordering as well as KDS in QSR environments.
No one actually thought that they were a good idea it was just a bunch of con artists. It was a bubble for sure but it was an entirely artificially created one. There was no real business behind any of it.
I doubt anyone is downplaying that. People are just discussing how all companies are pushing A.I into products that don't need it. Idk about you but I'm tired seeing A.I advertised as a feature on every app/site when it's just a gpt wrapper.
The rot has even spread into hardware. No one wants die space wasted on a stupid NPU with with less than 1/1000 of the computing power their GPU has and can't be used for anything other than local LLMs which FTI very few people use and those that do tend to have powerful Nvidia GPUs.
.com websites didn't disappear after the dotcom bubble burst either. AI is definitely in a massive bubble right now, but something being in a bubble doesn't mean it's going to vanish completely. The AI companies with some substance backing them will weather the upcoming storm.
Full disclosure: I don't hate AI, but I hate that management-types are fellating themselves to the idea of it or the things than it can potentially do, rather than something that is providing them some kind of concrete benefit right now. I'm also mad at consumers for being stupid little sheep and paying a premium for anything that companies just happen to slap an "AI-powered" sticker on. It's like organic produce 2.0 - you have to have it, but we can't explain why, nor can we elaborate on what it does better than it's contemporary.
Sure, but the difference here was that all those companies were offering something different. Some had better results than others, a better ui, more accuracy in certain niches, etc. But 99% of AI companies now are all effectively reselling the OpenAI API. They aren’t making an effort to differentiate themselves at all. It’s as if Google was the only shop in town, and everyone bought all their search data an algorithms to slap their logo on. That’s just simply not sustainable at anywhere near the scale it is now. This won’t be a 3-5 year decline, it’ll be a 2 month crash.
Same thing happened to the Dot Com bubble. The fundamental technology has valid uses, but we're in the stage where some people are convinced it can be used for literally anything.
It will burst because no one is going to pay subscription fee for every AI gizmo every app puts in your phone. The way they make any money now is just funneling more and more vc money in exchange of AGI promise (coming soon)
So, I have clients that are actively using AI on a daily basis and LOVE it. It is however a very narrow subset. Also, I’m pretty sure that a LARGE amount of Dollars are currently being spent on AI generated political articles.
The dot com crash was because tech companies were massively overvalued and didn't have a proper business plan or profit. I definitely see some similarities with the AI bubble, especially with the large unprofitable companies like OpenAI. OpenAI isn't estimated to become profitable until 2029, and there's a lot of unknowns between now and then (e.g. maybe they'll be forced to license content they use for training).
People look at the advertising for this shit (and future tech-bro shit) and wonder, "who is this for"? Remember E.L.O.N.
Exaggerated
Lies
Overlooked
Narratives
Think of every manager and boss you've ever had. They don't think, they just do. Salesmen convince them using issues that don't exist, to sell solutions that don't really work, to people that don't understand how to use them. Repeat over 70 years and you have the modern American education system.
Now things are different. Money is scarce, things are getting tight. Tech-Bros have changed from a mildly infuriating strategy, to a downright abusive one. These simple minded managers think everything is under attack, and the only solution is what they already have, but heavily monetized and completely unusable.
As someone who follows the startup space (and is thinking of starting their own, non-AI driven startup), the issue is all of the easily solvable problems have already been solved. The only thing that shakes up the tree is when new tech comes along and makes some of the old problems easy to solve.
So take a look at crypto - If you wanted to make a tip bot on Telegram, before crypto that was really hard. You needed to register with something like PayPal, have the recipient register with PayPal, etc etc etc. After crypto it was "Hey this person sent you 5$, use this private key if you want to recover it" (btw I made this service and it was used a lot).
Now look at AI - Imagine making a service that detects CSAM before AI took off. As an aside, I did NOT make this service, but I know a group of people who did. Imagine trying to make this without the AI boom - you'd need millions of images for training data, a PhD in machine learning, and so much more. Now, anyone can make it in their basement.
The point is, investors KNOW the bubble is a bubble and that it will pop. It doesn't matter though. They're looking for people who will solve problems that previously cost 1bln to solve with only 1mln of funding. If even 1% of their companies pay off, they make a profit.
problem is, the amount of soap(money) that goes around to make the bubbles keeps shrinking because the bubbles are siphoning it away from the consumers.
I wonder what happens when there's no more soap left to go around?
If even 1% of their companies pay off, they make a profit.
I suspect they make a profit even when 0% pan out. They just need to find someone gullible enough to buy in at the peak, and there's a new sucker born every minute.
Yeah, AI is really just a surveillance tool than anything else.
When AI "creates" something, it's just pulling up things related to words you typed in and making an amalgamation of what you typed in out of what it has.
The real purpose is for corporations and governments to look through people's devices and online storage at super speed.
this is why you all need to be using end-to-end encrypted storage for everything and VPNs with perfect forward secrecy
do your own research into the history of each provider of those things before you buy it
AI is a range of technologies. So yes, you can make surveillance with it, just like you can with a computer program like a virus. But obviously not all computer programs are viruses nor exist for surveillance. What a weird generalization. AI is used extensively in medical research, so your life might literally be saved by it one day.
You're most likely talking about "Chat Control", which is a controversial EU proposal to scan either on people's devices or from provider's ends for dangerous and illegal content like CSAM. This is obviously a dystopian way to achieve that as it sacrifices literally everyone's privacy to do it, and there is plenty to be said about that without randomly dragging AI into that. You can do this scanning without AI as well, and it doesn't change anything about how dystopian it would be.
You should be using end to end regardless, and a VPN is a good investment for making your traffic harder to discern, but if Chat Control is passed to operate on the device level you are kind of boned without circumventing this software, which would potentially be outlawed or made very difficult. It's clear on it's own that Chat Control is a bad thing, you don't need some kind of conspiracy theory about 'the true purpose of AI' to see that.
Same here. And speaking of bubbles I haven't seen anything about NFTs in quite a while. I don't think that bubble burst tho, it just sort of shriveled up and blew away.
Eh... "Robin Li says increased accuracy is one of the largest improvements we've seen in Artificial Intelligence. "I think over the past 18 months, that problem has pretty much been solved—meaning when you talk to a chatbot, a frontier model-based chatbot, you can basically trust the answer," the CEO added."
That's plain wrong. Even STOA black box chatbots give wrong answer to the simplest of questions sometimes. That's precisely what NOT being able to trust mean.
How can one believe anything this person is saying?
“probably 1% of the companies will stand out and become huge and will create a lot of value, or will create tremendous value for the people, for society. And I think we are just going through this kind of process.”
Wow, a CEO who doesn’t buy into the hype? That’s astonishing.
I, for one, cannot wait for the bubble to burst so we can get back to some sense of sanity.
Edit>> Though if Baidu is investing in AI like all the rest, then maybe they just think they’ll be immune — in which case I’m sad again that I haven’t yet come across a CEO who calls bullshit on this nonsense.
AI will have its uses, and it has practical use cases such as helping people to walk or to speak or to translate in real time, etc. But we’re decades away from what all these CEOs seem to think they’re going to cash in on now. And it’ll be fun on some level watching them all be wrong.
Edit>> Though if Baidu is investing in AI like all the rest, then maybe they just think they’ll be immune — in which case I’m sad again that I haven’t yet come across a CEO who calls bullshit on this nonsense.
They may just have kept their AI investments responsible—that is, not put more money into it than they can afford to lose. Keep in mind, Baidu is the Chinese equivalent of Google. They have a large, diversified business with many income streams. I expect they'll still be around after the bubble bursts.
I think less restrictive AI that are free, like Venice AI (you can ask it pretty much anything and it will not stop you) will be around for longer than ones that went with restrictive subscription models, and that eventually those other ones will become niche.
New technology always propagates further the freer it is to use and experiment with, and ChatGPT and OpenAI are quite restrictive and money hungry.