Using A.I. to generate a high level summary of Steam Reviews

[DragonStar]

In the day and age of AI, why not use AI analysis to give us a high level summary of all reviews for a game? So we don't have to read long paragraphs of mind-numbing wall of texts.

review system needs updating anyway. Either come up with a 5 point survey system or simply thumbs up or down. OR ... if you must force us to read reviews, using AI can help greatly. AI based testing is quite rampant these days.

We don't have time to read a life story of why someone likes or does not like a game that often says the same story in different words. Half the reviews are usually unintelligible jargon of either seething hatred, similar complains about game-play, or drooling delirious fans over-glorifying every smallest detail.

Using AI to deliver a good overview of the game might benefit Valve Greatly!

[Ben Lubar]

If you don't want to read reviews, you can just look at the percent of them that were positive. Text-generating neural networks have trouble summarizing coherent text. They'd have no chance on Steam reviews.

[虎🐯]

they could do this without AI by just searching for common words throughout posts like a lot of online retailers do for product reviews, would be way cheaper

[Ben Lubar]

I have an idea - what if they showed you the reviews that the most people found helpful?

[Knee]

Even AI is opinionated and contains only part of what someone digging through reviews is searching for.

[JamesF0790]

Nguyên văn bởi Ben Lubar:

I have an idea - what if they showed you the reviews that the most people found helpful?

A brilliant idea? Maybe they could include a way to vote for reviews to be helpfull? :)

[Nx Machina]

Nguyên văn bởi DragonStar:

In the day and age of AI, why not use AI analysis to give us a high level summary of all reviews for a game? So we don't have to read long paragraphs of mind-numbing wall of texts.

No one is forcing you to read reviews.

Nguyên văn bởi DragonStar:

review system needs updating anyway. Either come up with a 5 point survey system or simply thumbs up or down. OR ... if you must force us to read reviews, using AI can help greatly. AI based testing is quite rampant these days.

5 Star - Must buy - recommended
4 Star - Nearly hits 5 star - recommended.
3 Star - Hit and miss - not recommended.
2 Star - Avoid - not recommended
1 Star - Avoid - not recommended

Again no one is forcing you to read reviews.

[76561197960287930]

Nguyên văn bởi DragonStar:

Using A.I. to generate a high level summary of Steam Reviews In the day and age of AI, why not use AI analysis to give us a high level summary of all reviews for a game? So we don't have to read long paragraphs of mind-numbing wall of texts.

review system needs updating anyway. Either come up with a 5 point survey system or simply thumbs up or down. OR ... if you must force us to read reviews, using AI can help greatly. AI based testing is quite rampant these days.

We don't have time to read a life story of why someone likes or does not like a game that often says the same story in different words. Half the reviews are usually unintelligible jargon of either seething hatred, similar complains about game-play, or drooling delirious fans over-glorifying every smallest detail.

Using AI to deliver a good overview of the game might benefit Valve Greatly!

Bot account scripting of DOTA 2 user reviews saying, The Best Game is benefiting Valve Greatly!

213 new positive reviews with The Best Game were dropped for DOTA 2 on May 10, 2024 in User Reviews Most Recent.

Steam has rules on user review manipulation. The United States and UK have laws on user fake and manipulated user reviews. And no one is doing any enforcing or removals of blatant spam, AstroTurf.

So just play DOTA 2. It's clearly The Best Game on Steam.

Using AI to generate even summary of reviews is questionable imo, considering all the garbage reviews, fakes and funny. Have you seen Mozilla Fakesopt?

https://www.fakespot.com/steam/dota-2

Our engine has profiled the reviewer patterns and has determined that there is high deception involved. - Our engine has determined that the review content quality is poor and untrustworthy.

but, The Best Game

[Crazy Tiger]

A summary of reviews will never be able to provide me with the info I need or want.

[76561197960287930]

Nguyên văn bởi Crazy Tiger:

A summary of reviews will never be able to provide me with the info I need or want.

How are reviewers describing this item?
good, best, bad, worst and every.

What more info is needed for say DOTA 2? The Best Game?

CS2 Most Helpful review info for the day,

cheaters

an everyday occurrence!

[76561197960287930]

Nguyên văn bởi eram:

gonna let ai play the game for you as well?

Yes! What is it with all those DOTA 2 and CS2 accounts all with the same user personas, avatars and matching user reviews for DOTA 2 or CS2 idling in game all day? Hmmmmmmm must be something there to enjoy.

[76561199559798421]

my honest opinion is that reviews are misleading, each person should evaluate a game by watching game play, doing research into the game, and then judging the game for themselves.

reviews are pointless reach for manipulation of public outlook, it is not factual information and should have zero baring on a consumers choice.

steam has manipulated reviews since they started publishing game and using the review system to push products at the customer.

reviews are misleading, I never put faith in a review and I am very suspicious of reviews that uptick poorly looking products.

[JamesF0790]

Nguyên văn bởi Everyone is Invited:

my honest opinion is that reviews are misleading, each person should evaluate a game by watching game play, doing research into the game, and then judging the game for themselves.

reviews are pointless reach for manipulation of public outlook, it is not factual information and should have zero baring on a consumers choice.

steam has manipulated reviews since they started publishing game and using the review system to push products at the customer.

reviews are misleading, I never put faith in a review and I am very suspicious of reviews that uptick poorly looking products.

I mean you're certainly entitled to your opinion. I don't see it quite that way though, I don't see the reviews as manipulated and consider them to honestly be one of the most trustworthy review systems. That said I do absolutely agree that people do more research than just look at reviews.

[Ben Lubar]

Nguyên văn bởi 76561197960287930:

Have you seen Mozilla Fakesopt?

https://www.fakespot.com/steam/dota-2

Our engine has profiled the reviewer patterns and has determined that there is high deception involved. - Our engine has determined that the review content quality is poor and untrustworthy.

Hmm, it says that 1% of my game's positive ratings are fake but it doesn't seem to give any way to view the reviews it thought were fake.

Edit: okay, it gets even worse. My game had a B rating with a suggested 1% reduction to the positive review percentage.

But Parkitect has...

https://www.fakespot.com/steam/parkitect

A D rating with a 0% suggested change to the review percentages.

The site claims the reviews are very fraudulent but also doesn't seem to have anything that would indicate fraud even mentioned anywhere.

[DragonStar]

thanks for the responses guys. I still do want to read reviews to a certain extent but some are just too long and have too many redundant and unnecessary details. A summary would certainly be nice.

What I meant by a 5 point survey is if everyone rated 5 questions 1 out 5 stars you could see common issues on a scale of 1 to 5 (buggy, bad performance, great gameplay, crashes) etc. in a glance

As for only showing helpful reviews - that could get mishandled. I quite frankly get very annoyed just seeing "xxx people found this review funny" whatever that is good for...if I wanted a laugh i would watch a comedy.

[Tito Shivan]

Nguyên văn bởi Crazy Tiger:

A summary of reviews will never be able to provide me with the info I need or want.

'inb4' the AI summary of the reviews is an ASCII artwork meme.