ES Recruitment Drive
Original Post
User Feedback on Trials
So basically, I thought it would be a good idea for users to have a thread where they could give feedback on the GM trials on how well they host, how they handle themselves, etc.
I'm sure a gm can handle having someone complain about his toribash tourney hosting skills, but in case, they shouldn't expect negative comments if they do their best, if their doing their best, then they should expect positive comments.
-----
Originally Posted by suomynona View Post
The argument for preventing trials from seeing it is because it's a potential two sided conflict of interest. Say that Alice (example) is an honest person who likes Bob as a person but thinks he would make a terrible GM. Is Alice more likely to post an honest and useful (to the staff) review of Bob if she is allowed to make her comments private or public? If she does review Bob honestly and Bob finds out, then has Alice sacrificed a potential friendship for the sake of helping an internet game?

Lets say I join in a trial hosted tourney, and he's really dull, so I decided to pop into the thread and say something like "Oh so and so was a bit of a drag today, it would be better if you acted a bit livelier my friend", why would someone overreact to this?

If Alice feels that her friendship could be in potential distress over one comment, she could simply not post there. But if a Trial where to hold a grudge to "Alice" over one negative comment, that would just be another reason as to not have him as a full gm.
Last edited by Worm; Dec 22, 2015 at 07:26 AM. Reason: <24 hour edit/bump
But if Alice doesn't post, then a potentially unsuitable GM is hired onto the staff. If Alice does post, at potentially some real or imagined personal social risk, then everything's fine, yes. If Alice does something a bit sneakier, such as PMing an admin in charge, then everything's probably fine, yes, but then the thread has failed to provide anything that people couldn't already do.
Squad Squad Squad lead?
The standardization of Toribash Squad roles may have gone too far!
Originally Posted by suomynona View Post
But if Alice doesn't post, then a potentially unsuitable GM is hired onto the staff. If Alice does post, at potentially some real or imagined personal social risk, then everything's fine, yes. If Alice does something a bit sneakier, such as PMing an admin in charge, then everything's probably fine, yes, but then the thread has failed to provide anything that people couldn't already do.

Alice doesn't post- I'm getting what you are trying to put out, but it seems like you're just desperate to close this idea now.


Let's say Alice doesn't post, thats the beauty of the thread, cause guess what?, their is more then one living person in the world that's able to type their opinion in the thread, so let's say alice doesn't post, yes that would be sad as her opinion isn't heard, but their will be others opinions to fill in her absence.


Let's say alice does post- If the trial holds a grudge against her, then the trial is A. immature B. Not fit for gm C. Wasn't her friend in the first place.
Last edited by Worm; Dec 22, 2015 at 07:36 AM.
The Alice and Bob example is meant to portray the argument for maintaining confidentiality between the commentators and the trials. The former case is still a potential problem, because of the assumption that other people have proper arguments for why Bob shouldn't be a GM. This isn't necessarily true: perhaps Alice has an IRL (or at least external to Toribash) relationship with Bob that provides her specific information on why Bob shouldn't be a GM that no one else in the community should have. This would, at first glance, seem really uncommon; but it has happened before.

I'm perfectly willing to accept that that specific separation isn't really a good idea in and of itself though: certainly, it'd be exceptionally hard to enforce on a technical level (What's to prevent a trial from creating an alt and reading the supposedly publicly available thread that way?). If we're going to have public commentary on the trials, it might as well be open to them as well.

Private commentary on the trials is already possible (though exceptionally infrequent), and I don't feel that it has been exceptionally unsuccessful.

I'd be perfectly happy with opening another discussion on whether or not the GMs as a whole are performing adequately to the community: This has been done in the past and has traditionally been at least somewhat helpful. Furthermore, the GMs have already been given their positions in full, and the comments on the GM team are generally not directed at individuals. Traditionally, individual complaints have been dealt with in Complain About Staff (which is currently where publicly listed complaints about trials would go anyways, under the current system; preferably after contacting the trial in question specifically).

I think the single largest complaint about the system your proposing comes from potential abuses of it. It is extremely common in voting systems with anything resembling actual consequences to put as little trust in the user as is possible to do so while still getting a useful result. This is not because we don't trust any one particular user, but that there's always the possibility of at least one particularly malicious user who wishes to take advantage of the system. You cannot design secure systems if you willfully overlook that potential malicious user.

Thus, in short, the system would appear to be abuse-able by a malicious regular user in the sense that there are methods by which to present relatively benign situations in extremely bad light. While such complaints are, of course, already possible; opening up such complaints to a discussion intended for this sort is probably not going to result in the kind of thread you had in mind. I'd really expect it to devolve into flaming or trolling, which would be extremely awkward to deal with, since a thread like this would also likely have a "We won't ban you for calling people idiots in this thread" sort of clause.

From the side of a malicious trial GM, there's enough stuff on that side as well. "If you help me get full GM, I'll do <X>" and whatnot becomes potentially possible. If it's done cleverly enough, it's possible to even deflect potential corruption reports if those sorts of things do come up. With the current status of the community having no positive say on the trial->GM progression, this is actually completely impossible; and the GMs have already been selected in a fashion that makes any one of them particularly unlikely to allow this to happen. The same cannot be said of the general community.

In short, I get that you want to assume that community is great and helpful. It's even, more often than not, true.

When it's not true, however, unless you've designed the systems to tolerate it not being true, everything breaks. Usually it's really dramatic when that happens, and the cleanup occupies a really significant amount of a decent amount of the staff's time.

As such, these systems should be designed around the concept of not that "Nothing will go wrong", but rather that "Nothing CAN go wrong". Not because placing trust in the user base is a bad thing, but because if it's misplaced in the user base it can turn into a real shit storm if it's not managed properly.

In this case, I feel the current system of trials works (quite) well, and that this system is likely to provide more potential and incentive for abuse if any particularly malicious user exists who wishes to take advantage of it. If you can show that it does not provide the potential for abuse, then there's really no problem at all with opening such a discussion.

I do also agree that the user base needs to be trusted with the ability to comment on the GMs: the GMs, as a whole, are definitely there to help the game be enjoyable by everyone in the community. Thus, any member of the community should have the right to comment or criticize their procedures (within reason, of course). To a similar extent, everyone has a recourse to complain about staff members they have grievances with in Complain About Staff. However, I do not feel that actively trying to involve the community at large in the Trial progression process will result in a better Trial progression process.
Squad Squad Squad lead?
The standardization of Toribash Squad roles may have gone too far!
Originally Posted by suomynona View Post
The Alice and Bob example is meant to portray the argument for maintaining confidentiality between the commentators and the trials. The former case is still a potential problem, because of the assumption that other people have proper arguments for why Bob shouldn't be a GM. This isn't necessarily true: perhaps Alice has an IRL (or at least external to Toribash) relationship with Bob that provides her specific information on why Bob shouldn't be a GM that no one else in the community should have. This would, at first glance, seem really uncommon; but it has happened before.

I'm perfectly willing to accept that that specific separation isn't really a good idea in and of itself though: certainly, it'd be exceptionally hard to enforce on a technical level (What's to prevent a trial from creating an alt and reading the supposedly publicly available thread that way?). If we're going to have public commentary on the trials, it might as well be open to them as well.

Private commentary on the trials is already possible (though exceptionally infrequent), and I don't feel that it has been exceptionally unsuccessful.

I'd be perfectly happy with opening another discussion on whether or not the GMs as a whole are performing adequately to the community: This has been done in the past and has traditionally been at least somewhat helpful. Furthermore, the GMs have already been given their positions in full, and the comments on the GM team are generally not directed at individuals. Traditionally, individual complaints have been dealt with in Complain About Staff (which is currently where publicly listed complaints about trials would go anyways, under the current system; preferably after contacting the trial in question specifically).

I think the single largest complaint about the system your proposing comes from potential abuses of it. It is extremely common in voting systems with anything resembling actual consequences to put as little trust in the user as is possible to do so while still getting a useful result. This is not because we don't trust any one particular user, but that there's always the possibility of at least one particularly malicious user who wishes to take advantage of the system. You cannot design secure systems if you willfully overlook that potential malicious user.

Thus, in short, the system would appear to be abuse-able by a malicious regular user in the sense that there are methods by which to present relatively benign situations in extremely bad light. While such complaints are, of course, already possible; opening up such complaints to a discussion intended for this sort is probably not going to result in the kind of thread you had in mind. I'd really expect it to devolve into flaming or trolling, which would be extremely awkward to deal with, since a thread like this would also likely have a "We won't ban you for calling people idiots in this thread" sort of clause.

From the side of a malicious trial GM, there's enough stuff on that side as well. "If you help me get full GM, I'll do <X>" and whatnot becomes potentially possible. If it's done cleverly enough, it's possible to even deflect potential corruption reports if those sorts of things do come up. With the current status of the community having no positive say on the trial->GM progression, this is actually completely impossible; and the GMs have already been selected in a fashion that makes any one of them particularly unlikely to allow this to happen. The same cannot be said of the general community.

In short, I get that you want to assume that community is great and helpful. It's even, more often than not, true.

When it's not true, however, unless you've designed the systems to tolerate it not being true, everything breaks. Usually it's really dramatic when that happens, and the cleanup occupies a really significant amount of a decent amount of the staff's time.

As such, these systems should be designed around the concept of not that "Nothing will go wrong", but rather that "Nothing CAN go wrong". Not because placing trust in the user base is a bad thing, but because if it's misplaced in the user base it can turn into a real shit storm if it's not managed properly.

In this case, I feel the current system of trials works (quite) well, and that this system is likely to provide more potential and incentive for abuse if any particularly malicious user exists who wishes to take advantage of it. If you can show that it does not provide the potential for abuse, then there's really no problem at all with opening such a discussion.

I do also agree that the user base needs to be trusted with the ability to comment on the GMs: the GMs, as a whole, are definitely there to help the game be enjoyable by everyone in the community. Thus, any member of the community should have the right to comment or criticize their procedures (within reason, of course). To a similar extent, everyone has a recourse to complain about staff members they have grievances with in Complain About Staff. However, I do not feel that actively trying to involve the community at large in the Trial progression process will result in a better Trial progression process.


You're arguement is still mediocre, as I could go in any thread and "Flame". What's to stop me from going in the rate the song above you thread and calling everybody's music taste shitty? What's to stop me from going in the event thread and calling someone's event terrible? You can't really say that my thread would be open to flaming when almost every other thread in Toribash is too.


The current Trial system is good right now yes, but having user feedback on who we appreciate or who we think is stepping their game up would be better. I mean, i'm plenty sure that we have got stuck with some rotten gm's in the past, and maybe we could of solved that with user feedback.


I mean, if you're that worried about trolls, I could moderate the damn thread myself..
Last edited by Worm; Dec 22, 2015 at 06:18 PM.
If you find a gm trial abusing their powers or not standing up to the standards already set, you are more than welcome to pm another GM about it. I've seen a few trials being forced to step down for a variety of reasons.
I think I might be retired.
More than often a trial when dealing with something that would require them to use their powers, is told to go and notify a full gm in order for there to be some supervision, or for the full to handle it if the trial can not do so. So it is rare that you will ever find a trial abusing powers. Not saying it won't happen, but I see no need for this thread when such a thing can be achieved by just about anyone who sees this rare event occur.
Last edited by Fates; Dec 23, 2015 at 01:04 PM.
[SIGPIC][/SIGPIC]
[VIBE] 2015~2016 | Team Pokemon | [Origin] 2014~2015 | Team Aikido | [Obey] ~Because Frost Said So...
Originally Posted by Fates View Post
More than often a trial when dealing with something that would require them to use their powers, is told to go and notify a full gm in order for there to be some supervision, or for the full to handle it if the trial can not do so. So it is rare that you will ever find a trial abusing powers.

I will just restrain myself from posting further, because I'd like to disagree. However, it isn't the point of this thread.
I think I might be retired.
Of course, you can always post in Complain About Staff regarding trials if you feel they've done something wrong. Considering now, only that staff groups supervisor can close those threads, so they'll hear your complaint. I know I've somewhat restated what suo already said, but it's absolutely correct.

Sending complaints to the lead GM or others is also acceptable, of course. I feel that the trial period is effective and more work is being done to improve it. But I don't think it is time to have the community come and judge trials themselves, the whole concept feels like it would overwhelmingly biased.
Originally Posted by Grohenbird View Post
I will just restrain myself from posting further, because I'd like to disagree. However, it isn't the point of this thread.

If you have knowledge of trials abusing their power please report it instead of making empty claims.


After every event their supervisors will write a review of how they did - we don't lie in these reviews. We sit and watch them set up and close the servers. We take a fully objective stance and give them a rating based on that. We don't get pissy if they've chosen a mod we don't like or anything else because we're not involved directly with the tourney. There is no need for community feedback because the community is very bias and becoming a trial becomes a popularity parade
[SIGPIC][/SIGPIC]
[4:37 PM] ponf: y'all might think i'm not wild enough to send dick pics over toribash
[4:37 PM] ponf: you'd be wrong
uwu i wuv you uwu