General Discussions        Page 1 of 2        Goto page 1, 2  Next

Some Improvements of Rating Functions (strongly recommend)

DotaStrategy.com Forum Index > General Discussions > Some Improvements of Rating Functions (strongly recommend)

Reply to topic
 Goto page 1, 2  Next

EniXBlaze


Dominating Posts: 131 Joined: 25 Jun 2007 4789 gold

Some Improvements of Rating Functions (strongly recommend)

Posted: Wed Mar 26, 2008 5:35 am

*Improvement 1: The Hidden Rating
The guide's rating is hidden to a reader as long as he does not rate it. Why ? There would be nothing to argue if the guide gets 4 or 5 five stars but if the guide gets only 2 or 3 stars, many people may think "Oh I will waste my time reading it" so the guide's objective value could be ignored. The change can really improve the equality of the ratings between guides.
Some positive replies of mods and supporting team:
-Nidoking:
Quote:
good point on the strat rating, so everyone will be forced or encourage to read the strats first before commenting or rating and increase their curiosity...

-Shimrra_3:
Quote:
Excellent point we have here. Therefore hot guides will be predetermined by number of comments instead of stars... I have an unfair advantage oh well.
Laughing
-dohyun99:
Quote:
...I think your idea is a good one! It would make people vote upon their own reason and not just "go with the crowd". Unless they read comments ofcourse but it still is nice idea.


*Improvement 2:The Rating Board


*Edited:-Removed "Comments"
-Change Average Points from stars to a number.

Please contribute more innovative ideas !
_________________
What if Mr.TerrorBlade has 100000 gold ? Sange & Yasha ? Eye of Skadi ? ButterFly ? NO! He will buy this :



Last edited by EniXBlaze on Wed Mar 26, 2008 10:44 am; edited 2 times in total


Reply with quoteView user's profileSend private message


Back to top
 

Counter_Force[X]


Winner of the first HGC
Godlike Posts: 2358 Joined: 13 Aug 2007 43279 gold

Posted: Wed Mar 26, 2008 9:03 am

EniXBlaze wrote:
*Improvement 1: The Hidden Rating
The guide's rating is hidden to a reader as long as he does not rate it. Why ? There would be nothing to argue if the guide gets 4 or 5 five stars but if the guide gets only 2 or 3 stars, many people may think "Oh I will waste my time reading it" so the guide's objective value could be ignored. The change can really improve the equality of the ratings between guides.
Some positive replies of mods and supporting team:
-Nidoking:
Quote:
good point on the strat rating, so everyone will be forced or encourage to read the strats first before commenting or rating and increase their curiosity...

-Shimrra_3:
Quote:
Excellent point we have here. Therefore hot guides will be predetermined by number of comments instead of stars... I have an unfair advantage oh well.
Laughing
-dohyun99:
Quote:
...I think your idea is a good one! It would make people vote upon their own reason and not just "go with the crowd". Unless they read comments ofcourse but it still is nice idea.


*Improvement 2:The Rating Board


Pay no attention to the percentage Laughing 'cause it's actually my joke.
....
Hysterical I'm gonna be late for school now ! See you again at night
disagree on all of them
i would say
only members with significant streak which proves that they're active can vote. noobish points doesnt count

lyngse wrote:

LOL this guide is just dumb! "spider has great lane domination" what if the enemy get wards? all players would unless they are as noobish as the people in that replay.
why oh why do u get vlads? u have the best lifesteal alrdy and vlads dmg is horrible.
btw black king bar is a must. u say u only need it when facing disablers. when do u not face disablers?
now i rate u fairly because it is well written and some good pictures and all, just too the "guide" is horrible.
sorry for my first comment i was just shocked. your guide contains alot of good stuff, the build and some tactics are great. but u should state that this guide is for easymode (noobmode). if u play a normal ap mode ur item build is unrealistic and you will probably face more experienced players. brood can be great, also with ur build, but owning will be ALOT harder.
btw the replay is shit. cm has no icebloc mirana doesnt hit with a single arrow etc. after 7 min u have 2 creep kils. lol thats em!
for cases as this, his argument has no points

i oppose good guide based on no of comments because some guide maker replies more frequently than others
_________________




Reply with quoteView user's profileSend private message


Back to top
 

Shimrra_3


Fine! Go build your tiny gun!
Support Team Posts: 1541 Joined: 19 Dec 2006 46834 gold

Posted: Wed Mar 26, 2008 10:08 am

Good point on there being lots of creator comments. I should know. But theres still the whole 'oh its this many stars I won't read it' issue. CF[X] has a better idea, you should only be able to rate if you are actually an active and valuable member of DS, rather than this random flamer who walked in for no apparent reason and doesn't even play DotA.
Rating Board... maybe visible only to the creator and/or mods. Another innovative idea.


And that comment from my Spider guide? Damn straight, no points in that at all!
_________________

Thanks Venzael for this sig!
"This is my world! You are not welcome in my world!" - TF2 Soldier
The Search Forum Tool is your friend...


Reply with quoteView user's profileSend private message


Back to top
 

killmore


Warnings : 4 Godlike Posts: 1369 Joined: 07 Feb 2007 32659 gold

Posted: Wed Mar 26, 2008 10:09 am

IMO Mods should just be the one ranking these strategies.

The Elders should know more.
_________________


I always have this strange feeling........
I think my Mother is an Alien


Reply with quoteView user's profileSend private message


Back to top
 

Matoumass


Killing Spree Posts: 51 Joined: 26 May 2007 1683 gold

Posted: Wed Mar 26, 2008 10:20 am

Basic ideas :

When it comes with voting, every member can read and read guides without voting. Now, to determine the rate of a guide, you have to put criterias based on ppl opinions about this guide. How can you make a rating very close to the opinion stated in comments ? Well, kind of tricky subject.

Anyway, you have nonetheless some clues about how to reproduce a perfect system. First of all, due to the fact you have different status for members (moderators, premium, ...), you may be willing to assimilate this rank to the wisdom and the knowledge of the member, thus considering one may be more able to judge a guide. That's where the weighting comes. but you have to pay attention to the scale used to weigh. A vote coming from a moderator cannot be worth ten times a member one. And remember, all this is just viable if the way of becoming a member, premium member, ... is based on criterias in relation with the number of posts, the quality of them, their relevance, ... Maybe you have subcategories for members, ... then use it to complex the thing !

You proposed 5 stars, thus 11 different ratings are available, and I think that's enough. When it comes to calculating the number of possibilities, due to the rating depending on the type of member and/or subcategory of member, you will have tons of possibilities, thus avoiding lots of scenarii where incoherence is obviously showed.

Now, what about the difference between the guys voting and the guys just reading ? Does that mean that a reader isn't someone who reads, then a kind of dude who has to be counted, with low weighting ? I think this is a solution that could be explored to come along with the rest. Some kind of trigger to ask him for voting when he decides to leave the page : if he votes, then counts it according to its status (then the weighting etc) and if not, just count a neutral vote with low-weighting (ie half his weighting according to his status : member, moderator, ...).

I don't have any more ideas for now, but that could come again. I would strongly recommend to seek the more possibilities possible, according to proper criterias attuned to the possibilities of reading/being a type of member/being a subtype of a type/...

Edit : English corrections. Sorry for the bad language.
_________________



Reply with quoteView user's profileSend private message


Back to top
 

EniXBlaze


Dominating Posts: 131 Joined: 25 Jun 2007 4789 gold

Posted: Wed Mar 26, 2008 11:08 am

No one can do this alone for sure. I think we need to discuss more seriously.
*Which Streak a member requires to be able to rate guides ?
*Should we apply Scale-System (i.e: 1 mod = 10 member)?

Please say something about my new Idea:
Defense and Prosecute System: The voter must show his reason to the public if he gave the guide below 8. The rating will be hanged within 6 days(which means it will be applied in 7th day). If the author is not satisfied with the reason, he has to point out the contradictions or the pointlessness of the reason. His defense is made public, every one can see them. Then the final decision is made by the others with voting within 2 days or 100 votes(excluded the defense and the offense). One voter will only have 3 chances to press the guide. If he fails 3 times, his vote will be blank.
*This was inspired by my favorite games - Phoenix Wright.


Above all, I don't want to make this only-a-premise when all people are doing so much for this.
P.s: Sorry if my English sucks.
_________________
What if Mr.TerrorBlade has 100000 gold ? Sange & Yasha ? Eye of Skadi ? ButterFly ? NO! He will buy this :



Last edited by EniXBlaze on Wed Mar 26, 2008 11:50 am; edited 1 time in total


Reply with quoteView user's profileSend private message


Back to top
 

Counter_Force[X]


Winner of the first HGC
Godlike Posts: 2358 Joined: 13 Aug 2007 43279 gold

Posted: Wed Mar 26, 2008 11:29 am

somewhat like 200 post
phoenix wright theory hurts mah head
_________________




Reply with quoteView user's profileSend private message


Back to top
 

Matoumass


Killing Spree Posts: 51 Joined: 26 May 2007 1683 gold

Posted: Wed Mar 26, 2008 11:38 am

EniXBlaze,

I think your system is getting more and more complex and, more important, more and more time-consuming for the quidam to give a rating.

I do think a rating shouldn't take more than a second to give. That means guessing a lots of assertions on the server-side (well, logically speaking of computation).

I would stick to a system where the status of the guy and the criterias he gives to the guide for a rating (not only stars, but maybe something else ?) mean everything for the member's side. For the server's side, criterias such I discussed previously could be a potential "lead".

Anyway, your proposition could make sense if members would be willing to take a long time to justify a vote, or take time to come back and confirm their vote (meaning a follow-up system to give warnings of non-confirmed ratings, ...). You see, that becomes a barrier for the member that doesn't come every day (for example, I have been coming here for a little bit but sometimes every week, not every day). That's why I think this is not fit, provided I am right on the assertion concerning your members. If everyone comes every single day, then there would be no point in my remarks and everyone could have the same weighting and the same chance (and righe under such circumstances) of giving a rating.

I hope I am clear enough, kind of "philisophical" lol, but that's exactly your point, wanting something closer to the guys you're trying to provide services with.

Edit : English
_________________



Reply with quoteView user's profileSend private message


Back to top
 

Counter_Force[X]


Winner of the first HGC
Godlike Posts: 2358 Joined: 13 Aug 2007 43279 gold

Posted: Wed Mar 26, 2008 11:47 am

Matoumass wrote:
EniXBlaze,

I think your system is getting more and more complex and, more important, more and more time-consuming for the quidam to give a rating.

I do think a rating shouldn't take more than a second to give. That means guessing a lots of assertions on the server-side (well, logically speaking of computation).

I would stick to a system where the status of the guy and the criterias he gives to the guide for a rating (not only stars, but maybe something else ?) mean everything for the member's side. For the server's side, criterias such I discussed previously could be a potential "lead".

Anyway, your proposition could make sense if members would be willing to take a long time to justify a vote, or take time to come back and confirm their vote (meaning a follow-up system to give warnings of non-confirmed ratings, ...). You see, that becomes a barrier for the member that doesn't come every day (for example, I have been coming here for a little bit but sometimes every week, not every day). That's why I think this is not fit, provided I am right on the assertion concerning your members. If everyone comes every single day, then there would be no point in my remarks and everyone could have the same weighting and the same chance (and righe under such circumstances) of giving a rating.

I hope I am clear enough, kind of "philisophical" lol, but that's exactly your point, wanting something closer to the guys you're trying to provide services with.

Edit : English
well said
"its just a game anyway"
_________________




Reply with quoteView user's profileSend private message


Back to top
 

EniXBlaze


Dominating Posts: 131 Joined: 25 Jun 2007 4789 gold

Posted: Wed Mar 26, 2008 11:51 am

Lol ;D. May be I'm over-ambitious.
_________________
What if Mr.TerrorBlade has 100000 gold ? Sange & Yasha ? Eye of Skadi ? ButterFly ? NO! He will buy this :



Reply with quoteView user's profileSend private message


Back to top
 

Counter_Force[X]


Winner of the first HGC
Godlike Posts: 2358 Joined: 13 Aug 2007 43279 gold

Posted: Wed Mar 26, 2008 11:57 am

EniXBlaze wrote:
Lol ;D. May be I'm over-ambitious.
true
and

"I'm in dire need of a helping hand. If you are Puck's user and DotA mechanic's expert and good at screen capturing please help me to complete my Puck's guide."

i just need screenies to complete whats left of mine ^_^
_________________




Reply with quoteView user's profileSend private message


Back to top
 

killmore


Warnings : 4 Godlike Posts: 1369 Joined: 07 Feb 2007 32659 gold

Posted: Wed Mar 26, 2008 12:31 pm

My Suggestion:

Dotastrategy should make a "Ratings Board of Panel".

Again the MODS will be the one to decide who will be the Panelers. What procedure will be used is later be decided if this Idea clicks.
_________________


I always have this strange feeling........
I think my Mother is an Alien


Reply with quoteView user's profileSend private message


Back to top
 

Counter_Force[X]


Winner of the first HGC
Godlike Posts: 2358 Joined: 13 Aug 2007 43279 gold

Posted: Wed Mar 26, 2008 12:39 pm

killmore wrote:
My Suggestion:

Dotastrategy should make a "Ratings Board of Panel".

Again the MODS will be the one to decide who will be the Panelers. What procedure will be used is later be decided if this Idea clicks.
kinda good but does not reflect community styles
_________________




Reply with quoteView user's profileSend private message


Back to top
 

crazyjane


Killing Spree Posts: 75 Joined: 05 Dec 2007 2379 gold

Posted: Wed Mar 26, 2008 12:40 pm

perhaps only those who have previously made guides can vote? everyone else can view and comment all the crap they want but it wont change the success of the guide, i know i have found some horribly rated guides to be quite successful. so maybe that would be reasonable, just have other guide makers rate guides.

Reply with quoteView user's profileSend private message


Back to top
 

killmore


Warnings : 4 Godlike Posts: 1369 Joined: 07 Feb 2007 32659 gold

Posted: Wed Mar 26, 2008 12:46 pm

I gues there shouldn't be Strat Ratings. Strategies before approved are scanned by MODS so we can say that it's a 50/50.

If there is some Crappy guides, I guess the MODS should be the one to be blamed.

Hehehehe.

Mods please don't get mad at me.

Just an opinion.
_________________


I always have this strange feeling........
I think my Mother is an Alien


Reply with quoteView user's profileSend private message


Back to top
 
 
Reply to topic
Page 1 of 2    Goto page 1, 2  Next



View previous topic   View next topic
All times are GMT

Display posts from previous:    

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Jump to:  


DotaStrategy.com Forum Index    .    General Discussions
Subscribe to Feed