Amendment: Removal of a separate "Evaluator" role

12 posts / 0 new
Last post
Madius
Madius's picture.
MediatorNewbie HelperSetting Department MemberSystem Department MemberStoryhostSite Lead
Last online
2 days 15 hours ago
Amendment: Removal of a separate "Evaluator" role

Hey folks,

So per our current site governance, we have players, ASHs, SHs and evaluators, with SH being a pre-req for being an evaluator:

http://vaxia.org/forums/site-gov-part-two-roles-and-responsibilities

"Evaluator
An evaluator must also be a storyhost. An evaluator is a site member who has received the additional training and responsibility to fulfill additional duties for departments, such as the ability to approve content flagged by the system as needing additional review. Training and testing evaluators is a joint effort by all departments to ensure they have a complete understanding of duties from multiple perspectives."

From a System perspective, though, I feel like as long as only SHs can be Evaluators, ALL SHs should be evaluators. Item and Character eval have become as easy as possible with the new interfaces, and the rules for both have gotten simplified, so it doesn't take a whole other course to become a proficient evaluator any more. And SHs can all benefit from awareness of the rules for items and char eval because they apply directly to session rewards and NPC creation.

So, since the skillset now seems redundant, I'm moving to merge the Evaluator role into the existing SH duties, thus removing the Evaluator role.

Thoughts? I'd love your collective feedback before launching the formal proposal in case there are misgivings, concerns, etc.

Keshana
Keshana's picture.
MediatorSetting Department MemberSystem Department MemberAssistant Storyhost - ASH1
Last online
3 months 2 days ago
Hmm.

System-wise, there is excellent foundation for this move. Setting would be a slight bit trickier, but then to me it seems to have always been a dialog among Evaluator, Setting, and the affected player. I don't see much changing other than a slightly larger pool of Evaluators, which could help make times when the current set are out that much easier and more efficient.

So, I can see this making the currently optional Eval course mandatory after, or concurrent with, ASH 3. As long as the common sense in the training is codified with the clause to get second eyes from System/Setting in grey areas, I see no major issue with this.

Zxehenia
Zxehenia's picture.
MediatorSetting Department MemberSystem Department MemberStoryhostSite Lead
Last online
40 min 55 sec ago
.

This is definitely something needed should anyone desire a role as a lead as well.

However I still think there should be like an eval kind of quiz to make sure that indeed everyone is on the same page, and perhaps just act as a way for people to keep such things sharp. It doesn't have to be mandatory. Unless I am missing stuff and all of that is being put in with the sh course regardless of which then that comment becomes moot and stuff. Sorry just a wee bit tired here.

As for setting wise - anything that raises a flag on setting in goes through the leads - however at any time any member of the setting dept can start up a discussion on the setting thread to get ideas/opinions from everyone that is a member. Then the leads can come through if there is any conflict and handle it. Though we are working on more documentation in regards to such things like what stuff is ok for a starting character (IE - minor nobility, certain starting ranks etc etc) which in the future should help some of that. Just life needs to not eat face

Madius
Madius's picture.
MediatorNewbie HelperSetting Department MemberSystem Department MemberStoryhostSite Lead
Last online
2 days 15 hours ago
Titular changes

The training would still be required - as Kesh suggested, it'll essentially get rolled into part of ASH 3 (current plan is to suggest an ASH take the final eval test while waiting on feedback to their test 3 answers, since that may take a while). Approval to the role of SH would then be contingent on passing Test 3 and the eval test, in whatever order the ASH chooses.

Zxehenia
Zxehenia's picture.
MediatorSetting Department MemberSystem Department MemberStoryhostSite Lead
Last online
40 min 55 sec ago
.

Yeah I kind of realized that as I was typing, its one of those fingers are running before the brain kindo f dealy :)

Bastlynn
Bastlynn's picture.
MediatorNewbie HelperSetting Department MemberSystem Department MemberStoryhostSite Lead
Last online
2 months 6 days ago
Speaking from a tech point of

Speaking from a tech point of view this would actually make the backend a bit more streamlined. I'd be very happy with that from a code and support perspective.

From a workflow perspective as an SH - yeah. I mean char eval and items really are streamlined at this point, we have lots of clear docs and stuff and even more ui assistance planned... and since SHs are going to be running into those things in running sessions it seems like a natural thing to merge in as part of the SH course training. :)

From a setting perspective - yeah - calling someone in for a consult or 2nd opinion should be fine really. We'd like to see the SH's working as a coherant team / partners overall really. So this seems like a good step towards that. :)

Madius
Madius's picture.
MediatorNewbie HelperSetting Department MemberSystem Department MemberStoryhostSite Lead
Last online
2 days 15 hours ago
Proposal reminder

Hey folks,

We have about a week left on the proposal:

http://vaxia.org/proposals/amendment-removal-separate-evaluator-role

If you haven't already voted, please do so, either way. We're currently shy a few votes to make it enough participation to be a legitimate proposal. Even if you're new and don't feel like you can weigh in, let us know what you think, and let us know if you have any questions before voting :)

Thanks, everybody!

Madius
Madius's picture.
MediatorNewbie HelperSetting Department MemberSystem Department MemberStoryhostSite Lead
Last online
2 days 15 hours ago
Once more unto the brink

Welp, good news is we had unanimous support for the proposed changes :)

http://vaxia.org/proposals/amendment-removal-separate-evaluator-role

Bad news is, we didn't get enough folks voting for it to be considered a valid amendment. Since there was zero opposition, I'm re-launching the proposal in hopes we'll hit the required minimums now.

Everyone, PLEASE take a moment to cast your anonymous vote, either way! For the newer folks, the required minimums are to make sure someone can't sneak a new amendment in during a downtime, like a holiday period, so it means despite 100% support among our seven voters, the amendment is currently denied. If you feel like you can't vote because you're too new, that's silly talk, you have as much right and voice as the rest of us.

Here's the new proposal: http://vaxia.org/proposals/removal-separate-evaluator-role

Again, if you have any questions before voting, please let us know, but again, PLEASE vote on the amendment so that we can consider it for approval or not based on a simple majority.

Thanks, everyone!

Madius
Madius's picture.
MediatorNewbie HelperSetting Department MemberSystem Department MemberStoryhostSite Lead
Last online
2 days 15 hours ago
Results are in

First a huge thanks to folks for the turnout :) I know not everyone gets personally invested in site changes, and I appreciate people taking the time to vote either way.

We do in fact have enough votes of active players this time for the results to count, and they are 11 to 1 in favor of the change.

http://vaxia.org/proposals/removal-separate-evaluator-role

What does this mean for the site? Outside some wording updates to the Governance, almost nothing. For ASHs in the SH Course, it means the Item and Character Evaluation training is no longer an optional add-on, but an essential part of your training. It also means that SHs get no special status for also being evaluators - if you're an SH, evaluation is part of the program.

I will work on addressing the wording in the governance to remove mention of a separate evaluator role and to move any mention of those duties within the standard SH wheel house.

Thanks again everyone! Any questions, just let us know!

Bastlynn
Bastlynn's picture.
MediatorNewbie HelperSetting Department MemberSystem Department MemberStoryhostSite Lead
Last online
2 months 6 days ago
Looks good and streamlines

Looks good and streamlines the back-end a lot. :)

So a little bit of an implementation question / confirming how we want to handle the testing sequences for this. I'm thinking the plan is to put the eval course between ash 2 and the final question/answer with no additional requirements for sessions run. That way it'll just be another flag along the way to make sure you've hit before going into the final steps. Lemme know if i'm reading that wrong.

Madius
Madius's picture.
MediatorNewbie HelperSetting Department MemberSystem Department MemberStoryhostSite Lead
Last online
2 days 15 hours ago
That seems reasonable

The eval walkthrough is the last automated exam in the course, and after ASH 2 any ASH has all they need to complete it when they go through the eval training. I'll work on getting the course page updated so that the workflow is clear on that front.

Madius
Madius's picture.
MediatorNewbie HelperSetting Department MemberSystem Department MemberStoryhostSite Lead
Last online
2 days 15 hours ago
Updated wiki

So since we didn't have one before, I went ahead and copied the content of our Site Constitution and all Amendments to date into two wiki pages, with references to the original uneditable proposals. We'll at least have them locked as far as Revisions go.

http://vaxia.org/wiki/site-constitution
http://vaxia.org/wiki/amendments

I've also updated the SH Course for the new structure of the former Test Four to now be the Content Evaluators exam for an ASH to complete any time after passing Test Two but before taking Test Three. Since they have to run 5 sessions during that time, it should be plenty of time to take a quick test on character and item eval.

http://vaxia.org/wiki/sh-course

Any questions, errors, etc, lemme know!