DIMEDROLL 5 Mar, 2013 - 16:46
How are rating stars calculated?
I have just checked out the new "Item Stats" page and now I see how many people voted up and down for my item. I get:
Total ratings 30
Positive ratings 28 (93% of total)
Negative ratings 2 (7% of total)

Workshop shows 3 of 5 stars rating. Why? I thought that those stars are directly related to users' positive\negative ratings.

http://steamcommunity.com/sharedfiles/filedetails/?id=125888855&searchtext=
Wyświetlanie 1-11 z 11 komentarzy
< >
Wowza 5 Mar, 2013 - 16:52 
I think the number of ratings are also a factor.
TomB  [autor] 5 Mar, 2013 - 21:33 
Wowza is correct in that the total number of ratings is factored in. We use what's called a bayesian average (see http://en.wikipedia.org/wiki/Bayesian_average).
DIMEDROLL 7 Mar, 2013 - 14:05 
This is great for making a list of most popular and highest rated items. When user clicks "Top Rated All Time" he gets the list of really good items and not some new items with 10 votes and 5 stars.

But when it comes to looking at the individual items it is a bit confusing. I'm saying about my own experience. When I see a map that has 30 votes and 3 of 5 stars I make a conclusion that this map is something very basic or not yet finished. I don't know that those stars are bayesian average, I think that it is just an average rating, a relation between likes and dislikes. So I don't waste my time trying it out, especially if there are higher rated maps.

I think it would be great to implicitly use bayesian average for the list "Top Rated All Time". And use just an average for displaying stars. Although it may be confusing for people to see a 5 star map being listed under the 4 star map :)
DIMEDROLL 8 Mar, 2013 - 8:27 
Also it can be better to be able to rate a workshop item from 1 to 5. Same like imdb.com rating works
TomB  [autor] 8 Mar, 2013 - 9:15 
Also it can be better to be able to rate a workshop item from 1 to 5. Same like imdb.com rating works

There have been several studies that show 5 star rating systems don't actually give us great data. We want users to make real choice. There is plenty of debate on this topic of course, but we feel like the up/down rating system is the simplest and gives us the best data.

Here are some informational links if you are interested:
  • http://youtube-global.blogspot.com/2009/09/five-stars-dominate-ratings.html
  • http://www.andymoore.ca/2010/02/bayesian-ratings-your-salvation-for-user-generated-content/
jessd 21 Lip, 2013 - 23:35 
gotta love the trolls comin in and givin a thumbs down just cuz they don't like the idea or style of the mod. what's with the thumbs down? i can understand if a mod doesn't work, but why allow people to vote a working mod down just because it's not their cup of tea? sounds like a good way to run the modders off. i know it frustrates me....
Ostatnio edytowany przez: jessd; 21 Lip, 2013 - 23:35
Sheep 19 Lut - 19:17 
Also it can be better to be able to rate a workshop item from 1 to 5. Same like imdb.com rating works

There have been several studies that show 5 star rating systems don't actually give us great data. We want users to make real choice. There is plenty of debate on this topic of course, but we feel like the up/down rating system is the simplest and gives us the best data.

Here are some informational links if you are interested:
  • http://youtube-global.blogspot.com/2009/09/five-stars-dominate-ratings.html
  • http://www.andymoore.ca/2010/02/bayesian-ratings-your-salvation-for-user-generated-content/
I know this is a while a go now, but how many ratings are required for a rating out of 5 stars? :)
DIMEDROLL 19 Lut - 20:34 
as guys already said it depends on how many ratings do other item have.
Sheep 20 Lut - 6:11 
as guys already said it depends on how many ratings do other item have.
Okay fair enough, wasn't sure if you needed say 10 ratings for it to be eligible for a 5 star rating, with the Bayesian Average being applied after that :P
gtamike_TSGK 5 Lip - 1:38 
gotta love the trolls comin in and givin a thumbs down just cuz they don't like the idea or style of the mod. what's with the thumbs down? i can understand if a mod doesn't work, but why allow people to vote a working mod down just because it's not their cup of tea? sounds like a good way to run the modders off. i know it frustrates me....

Yeah it's odd you can vote when the person has not even download the item.
Catalin 5 Lip - 4:01 
sadly that trolls are everywhere
Wyświetlanie 1-11 z 11 komentarzy
< >
Na stronę: 15 30 50
Data napisania: 5 Mar, 2013 - 16:46
Posty: 11