2023's AI BOOM make GPU Prices SURGE..

[Lone Wolf]

whats peoples thoughts on this J2C on youtube all so hit this up in one his videos ?

https://www.youtube.com/watch?v=02-n2wk8EI4

[AbedsBrother]

Not currently seeing a price increase in the US. Hard to tell if this is an isolated incident of someone buying a pallet of 7900xtx's that went viral, or if there really is a growing rush on AI-capable gpus.

Kind of weird that it's Radeon, their consumer AI tech isn't anywhere near Nvidia's atm.

[Lone Wolf]

AbedsBrother님이 먼저 게시:

Not currently seeing a price increase in the US. Hard to tell if this is an isolated incident of someone buying a pallet of 7900xtx's that went viral, or if there really is a growing rush on AI-capable gpus.

Kind of weird that it's Radeon, their consumer AI tech isn't anywhere near Nvidia's atm.

a lot the tec people saying its only the RTX crads that good for AI in some videos iv seen

[emoticorpse]

This should get people screaming.

[Introverted Gamer]

AbedsBrother님이 먼저 게시:

Kind of weird that it's Radeon, their consumer AI tech isn't anywhere near Nvidia's atm.

Yup. AMD still has a lot to catch up vs NVIDIA in the Workstation and content creation category.

[Lone Wolf]

emoticorpse님이 먼저 게시:

This should get people screaming.

well at the mo prices in england new and used are good theres some good deals on gpu,s used i got a 1060 gtx just 35 pounds but if this is the new trend AI we can soon see prices go up like bit-coining

[Illusion of Progress]

Aren't the dedicated AI chips much better for this? I can only see this happening if the cost per performance value of "GPUs" is far favorable versus AI chips AND if the lower performance of GPUs is still enough.

Like maybe smaller ventures might be better served by a handful of GPUs compared to proper AI chips.

Personally I'm not TOO worried. The difference with mining was it allowed GPUs to become income generators passively, and to anyone. You can make money with GPUs for AI or creating content... but that's just using them as a method to do work. You still have to do the work. Mining was far, far more passive and accessible. That's what allowed the value on them to skyrocket.

Youtubers will make videos for traffic, and I get the impression that's what this is. If there was substance to this possibly resulting in skyrocketing GPU value, it'd probably already be happening. That's how it went with mining anyway; the effects actually occurred before publications like websites and Youtubers actually caught on and started pointing it out.

As always though, time will tell. But I don't see this an analogous to the mining situation at all.

[HypersleepyNaputunia]

nvidia cards work better on some ofthe ai so the boom will be on those if it happens

[Omega]

The AI boom is actually an AI bubble. The hype has already ceased and the sector is calming down now that investors have started to develop more realistic views on the tech.

I expect it to have no meaningful impact on consumer hardware prices.

AbedsBrother님이 먼저 게시:

Not currently seeing a price increase in the US. Hard to tell if this is an isolated incident of someone buying a pallet of 7900xtx's that went viral, or if there really is a growing rush on AI-capable gpus.

Kind of weird that it's Radeon, their consumer AI tech isn't anywhere near Nvidia's atm.

CUDA, that is the only reason Nvidia is the go-to for these type of workloads. Everything is build around CUDA which is exclusive to Nvidia.

GUNSMOKE999님이 먼저 게시:

AbedsBrother님이 먼저 게시:

Not currently seeing a price increase in the US. Hard to tell if this is an isolated incident of someone buying a pallet of 7900xtx's that went viral, or if there really is a growing rush on AI-capable gpus.

Kind of weird that it's Radeon, their consumer AI tech isn't anywhere near Nvidia's atm.

a lot the tec people saying its only the RTX crads that good for AI in some videos iv seen

A GPU is a GPU, we ML on 2080 Tis. The workload will define if the hardware is sufficient or not. And in 99% of cases these cards are perfectly sufficient, not everyone is training the next ChatGPT, most ML projects are much smaller in scale and easier to train.

Illusion of Progress님이 먼저 게시:

Aren't the dedicated AI chips much better for this? I can only see this happening if the cost per performance value of "GPUs" is far favorable versus AI chips AND if the lower performance of GPUs is still enough.

Like maybe smaller ventures might be better served by a handful of GPUs compared to proper AI chips.

"AI accelerator" is a very broad term which applies to any type of processor. The most suitable solution will depend on the workload being performed,

This tech is still very much in development and we do not know where it will go. For example some upcoming methods are doing ML on the CPU instead.

[BloodShed]

GUNSMOKE999님이 먼저 게시:

AbedsBrother님이 먼저 게시:

Not currently seeing a price increase in the US. Hard to tell if this is an isolated incident of someone buying a pallet of 7900xtx's that went viral, or if there really is a growing rush on AI-capable gpus.

Kind of weird that it's Radeon, their consumer AI tech isn't anywhere near Nvidia's atm.

a lot the tec people saying its only the RTX crads that good for AI in some videos iv seen

For 'hobbyist' perhaps.
Nvidia's H100 and A100 are the best suited for the job.

[Omega]

BloodShed님이 먼저 게시:

GUNSMOKE999님이 먼저 게시:

a lot the tec people saying its only the RTX crads that good for AI in some videos iv seen

For 'hobbyist' perhaps.
Nvidia's H100 and A100 are the best suited for the job.

"Best suited" as-in they are some of the fastest high-memory cards available?

For the vast majority of ML implementations a high-end consumer card is more than sufficient. Like I said in my previous post, not everyone is building the next ChatGPT.

[AbedsBrother]

Omega님이 먼저 게시:

AbedsBrother님이 먼저 게시:

Not currently seeing a price increase in the US. Hard to tell if this is an isolated incident of someone buying a pallet of 7900xtx's that went viral, or if there really is a growing rush on AI-capable gpus.

Kind of weird that it's Radeon, their consumer AI tech isn't anywhere near Nvidia's atm.

CUDA, that is the only reason Nvidia is the go-to for these type of workloads. Everything is build around CUDA which is exclusive to Nvidia.

That's the point I was making. Why is the "rush" (real or fake) focusing on Radeon? With Nvidia being better at AI - even in consumer gpus - it should be the RTX 4xxx series that are being hoarded. From both a performance and a power draw perspective. There is no AI-acceleration scenario (currently) where hoarding Radeon consumer gpus makes sense.

[Illusion of Progress]

Omega님이 먼저 게시:

"AI accelerator" is a very broad term which applies to any type of processor. The most suitable solution will depend on the workload being performed,

Right, I understand that.

My knee-jerk reaction was more that because we hadn't seen the sky fall, so to speak, with prices skyrocketing already, that either the "dedicated AI chips" like the H100s either have a much more effective results for the price ratio, or that there was more to it.

Either way I'm definitely not concerned of this becoming the next mining equivalent that skyrockets GPU value. There was a lot more to things with the Ethereum occurrence that aren't really present here. So the video just seems like its trying to attract views.

[Omega]

Illusion of Progress님이 먼저 게시:

Omega님이 먼저 게시:

"AI accelerator" is a very broad term which applies to any type of processor. The most suitable solution will depend on the workload being performed,

Right, I understand that.

My knee-jerk reaction was more that because we hadn't seen the sky fall, so to speak, with prices skyrocketing already, that either the "dedicated AI chips" like the H100s either have a much more effective results for the price ratio, or that there was more to it.

Either way I'm definitely not concerned of this becoming the next mining equivalent that skyrockets GPU value. There was a lot more to things with the Ethereum occurrence that aren't really present here. So the video just seems like its trying to attract views.

A single H100 is 30K or something, that is more than most ML teams spend on their entire infrastructure.

The H100 is only suitable for the most demanding of tasks.

I don't think the ML field is going to make a noticable impact on chip availability, but it will most certainly have an impact on R&D, consumers are second class citizens now.

When these cards are needed they are typically just rented in the cloud. You can have a T4 for $150 a month or something. And you will be using it for may a couple of hours at most. ADding up to maybe $10 a month.

[Rod]

UK 4090 prices dropped sub msrp recently. £1519 MSRP but gamerock 4090 on sale for £1499.

[Tiberius]

Its not like avg ppl have enough money to buy new gpus these days lel