DIMEDROLL 5 Mar 2013 @ 4:46pm
How are rating stars calculated?
I have just checked out the new "Item Stats" page and now I see how many people voted up and down for my item. I get:
Total ratings 30
Positive ratings 28 (93% of total)
Negative ratings 2 (7% of total)

Workshop shows 3 of 5 stars rating. Why? I thought that those stars are directly related to users' positive\negative ratings.

http://steamcommunity.com/sharedfiles/filedetails/?id=125888855&searchtext=
11 yorumdan 1 ile 11 arası gösteriliyor
< >
Wowza 5 Mar 2013 @ 4:52pm 
I think the number of ratings are also a factor.
TomB  [geliştirici] 5 Mar 2013 @ 9:33pm 
Wowza is correct in that the total number of ratings is factored in. We use what's called a bayesian average (see http://en.wikipedia.org/wiki/Bayesian_average).
DIMEDROLL 7 Mar 2013 @ 2:05pm 
This is great for making a list of most popular and highest rated items. When user clicks "Top Rated All Time" he gets the list of really good items and not some new items with 10 votes and 5 stars.

But when it comes to looking at the individual items it is a bit confusing. I'm saying about my own experience. When I see a map that has 30 votes and 3 of 5 stars I make a conclusion that this map is something very basic or not yet finished. I don't know that those stars are bayesian average, I think that it is just an average rating, a relation between likes and dislikes. So I don't waste my time trying it out, especially if there are higher rated maps.

I think it would be great to implicitly use bayesian average for the list "Top Rated All Time". And use just an average for displaying stars. Although it may be confusing for people to see a 5 star map being listed under the 4 star map :)
DIMEDROLL 8 Mar 2013 @ 8:27am 
Also it can be better to be able to rate a workshop item from 1 to 5. Same like imdb.com rating works
TomB  [geliştirici] 8 Mar 2013 @ 9:15am 
DIMEDROLL tarafından gönderilen ileti:
Also it can be better to be able to rate a workshop item from 1 to 5. Same like imdb.com rating works

There have been several studies that show 5 star rating systems don't actually give us great data. We want users to make real choice. There is plenty of debate on this topic of course, but we feel like the up/down rating system is the simplest and gives us the best data.

Here are some informational links if you are interested:
  • http://youtube-global.blogspot.com/2009/09/five-stars-dominate-ratings.html
  • http://www.andymoore.ca/2010/02/bayesian-ratings-your-salvation-for-user-generated-content/
jessd 21 Tem 2013 @ 11:35pm 
gotta love the trolls comin in and givin a thumbs down just cuz they don't like the idea or style of the mod. what's with the thumbs down? i can understand if a mod doesn't work, but why allow people to vote a working mod down just because it's not their cup of tea? sounds like a good way to run the modders off. i know it frustrates me....
En son jessd tarafından düzenlendi; 21 Tem 2013 @ 11:35pm
It ain't nova 19 Şub @ 7:17pm 
TomB tarafından gönderilen ileti:
DIMEDROLL tarafından gönderilen ileti:
Also it can be better to be able to rate a workshop item from 1 to 5. Same like imdb.com rating works

There have been several studies that show 5 star rating systems don't actually give us great data. We want users to make real choice. There is plenty of debate on this topic of course, but we feel like the up/down rating system is the simplest and gives us the best data.

Here are some informational links if you are interested:
  • http://youtube-global.blogspot.com/2009/09/five-stars-dominate-ratings.html
  • http://www.andymoore.ca/2010/02/bayesian-ratings-your-salvation-for-user-generated-content/
I know this is a while a go now, but how many ratings are required for a rating out of 5 stars? :)
DIMEDROLL 19 Şub @ 8:34pm 
as guys already said it depends on how many ratings do other item have.
It ain't nova 20 Şub @ 6:11am 
DIMEDROLL tarafından gönderilen ileti:
as guys already said it depends on how many ratings do other item have.
Okay fair enough, wasn't sure if you needed say 10 ratings for it to be eligible for a 5 star rating, with the Bayesian Average being applied after that :P
gtamike_TSGK 5 Tem @ 1:38am 
jessd tarafından gönderilen ileti:
gotta love the trolls comin in and givin a thumbs down just cuz they don't like the idea or style of the mod. what's with the thumbs down? i can understand if a mod doesn't work, but why allow people to vote a working mod down just because it's not their cup of tea? sounds like a good way to run the modders off. i know it frustrates me....

Yeah it's odd you can vote when the person has not even download the item.
Catalin 5 Tem @ 4:01am 
sadly that trolls are everywhere
11 yorumdan 1 ile 11 arası gösteriliyor
< >
Sayfa başına: 15 30 50
Gönderilme Tarihi: 5 Mar 2013 @ 4:46pm
İleti: 11