Some Ideas for Testing Zone

Suggestions 🙌
1

Hello everyone! This is my first time posting in suggestions. I was contemplating a recent discussion opened by @ADO9412 about some of the issues with the testing zone, namely repetitive testing calls and lack of originality as well as idea-theft and such. If you haven’t read the topic I suggest giving it a look: Frustrated with pattern testing and over saturation of the same patterns

So, I had some thoughts about what might be done to improve the testing zone. Please bear with me through this, as I’m terrible at summarizing thoughts.

  • If we had a dedicated section in the testing zone for new designers to post generic beginner pattern testing calls, so that they can still benefit from tester feedback without crowding the testing zone where more experienced designers could post testing calls. I think it’s a really good way to learn better design skills, and I would imagine it would encourage those who are learning their way around designing.

  • What if we had a kind of review system where designers can essentially rate their testers after they’ve tested their pattern? Like after they finish their test, some feedback questions on the tester can show up for the designer to rate them. Yes/No questions like ‘Did this tester offer valuable feedback?’, ‘Did this tester communicate effectively?’, ‘Did this tester help you improve your pattern?’, ‘Did this tester complete their test punctually?’, and then a question asking about overall satisfaction of the tester’s performance with a scale from ‘not at all satisfied’ to ‘very satisfied’. Then the option to write a review of this tester if desired.

  • The purpose of the above is to create a ‘tester profile’ for the following idea: To try to circumvent the issue of people copying a pattern idea after it’s been posted in the testing zone, perhaps we could introduce an exclusive section of the testing zone for ‘verified testers’. Like, a tester has to have a certain amount of karma points and a certain satisfaction rating from designers (like maybe minimum 70% satisfaction) to become a verified tester, and have access to the verified testing zone. This way any designer who has a pattern that they want to test more seriously, they can do so in the verified tester zone without worry of public-viewing and people stealing the idea. And they can ensure quality testing at the same time.

So, the testing zone would be divided into three main zones: beginner testing zone, general testing zone, and verified testing zone. Each serving their own purpose and hopefully enhancing the testing experience.

Um, yeah. That’s the long and short of it I guess. I’m sure this could have been a lot shorter, so I apologize. Let me know what you all think, if these are ideas you’d maybe like considered as well, and if you think of any ideas to add!

12 Likes
2

I love this idea! I’ve been thinking we should be able to leave notes about testers since karma leaves out so much (size of the project, did they communicate, did they offer feedback or just say “looks good!”, etc.)

6 Likes
3

Regarding new designers:

I think we should remember that not all new designers are new crocheters. Many new designers are experienced crocheters and have decided they are now proficient enough in their skills and knowledge to try their hand at designing.

I think the issue lays with inexperienced crocheters, not learning how to crochet properly first, before trying to create patterns. This is what I believe results in copying the same unidentifiable objects, balls, pickles, bees, frogs, turtles and so on. I understand new crocheters are also keen to learn about pattern making and I think that is commendable. However, I feel it’s necessary for new crocheters to actually learn how to crochet first.

Therefore, I think a subsection in the testing zone for beginner crocheters is a more suitable alternative than a section for new designers.

6 Likes
4

Regarding the review system for testers:

I’m of the impression that Ribblr’s current system fulfills this adequately. We have the Karma system that shows tests completed versus not completed and testers who complete the test as outlined in the tester call are gifted the patterns as ‘payment’ of their services.

To me, this feels a little too targeted and personal, although these are very valid questions to ask.

I feel that any feedback is valuable, whether it is used by the designer or not.

Some testers also finish very quickly and are able to address the issues within a pattern before others get to that section. Therefore, the testers who finish the test last may not need to provide as much/any feedback other than saying they found no issues with the pattern.

Some pattern designers are so good at what they do, I don’t find any issues with their patterns, whilst others I go back and forth finding issues and/or making suggestions.

Not everyone is able to/finds it easy to communicate, express themselves, put things into words as well as others. Do we ‘punish’ those who struggle with this.

If the tester didn’t complete the test by the due date, this is reflected in the testers Karma and they also do not receive the pattern as payment for completing the test.

I feel that when conducting a pattern test, both the designer and tester/s develop a ‘relationship’ and some really work well together whilst others don’t. If you’re unhappy with a tester you can simply avoid choosing them again in future tests. Just as a tester can avoid applying for a test with a designer they didn’t ‘gel with’ in a previous tester call. I know we all have lists of testers/designers we’d rather not work with again.

Some testers work better with some designers better that others and vice versa, so I do feel the current system works.

Another thing I’ve noticed is a lot of posts and comments related to testers. Whilst I agree there are some testers who do the wrong thing - don’t complete the test on time, don’t provide feedback on problems with the pattern, even when they’re glaringly obvious to others, only want a free pattern and don’t really focus on testing the pattern etc, there is also a problem with some pattern designers.

Of all the pattern tests I’ve done to date, the majority of them have been fantastic. However, my experience with a few designers have been less than ideal. The issue predominantly relates to designers who have ghosted the tester call, as well as designers who don’t want to make integral modifications to their patterns prior to releasing them for sale.

If you were to have a survey for the designers to complete regarding testers, there should also be a survey for testers to complete regarding the designers. Questions to consider for that survey could include:

  • Did you feel the designer was open to your suggestions?
  • Did the designer use any of your suggestions?
  • Did the designer communicate effectively?
  • Were any issues with the pattern corrected by the designer?
5 Likes
5

You’re right, my mistake. I did mean more so new crocheters, so your suggestion would be a more suitable alternative!

3 Likes
6

I really appreciate this comment, you touched on a lot of the things I thought in my head but left out in my original post for fear of being too wordy and detailed lol.

To me, this feels a little too targeted and personal, though these are very valid questions ask.

I feel the need to clarify, all of those questions were just examples I was throwing onto the screen to get an idea across, not really a clear draft of exactly what should be asked or how.

I also think any feedback is valuable, my example questions did not reflect an objective framework of analysis. I apologize for the lack of clarity on my part there.

Not everyone is able to/finds it easy to communicate, express themselves, put things into words as well as others. Do we ‘punish’ those who struggle with this.

I know communication varies person to person and not everyone is able to engage in the same capacity as others. I myself am autistic, so I’ve experienced both ways before. My example question was sort of generally addressing communication when necessary. For example, if a tester is unable to finish on time and needs an extension, or if the tester is personally addressed by the designer in the gc and needs to respond, etc..

I did not carefully word the questions as I wasn’t trying to give a framework, though I should have stated that

2 Likes
7

I feel that when conducting a pattern test, both the designer and tester/s develop a ‘relationship’ and some really work well together whilst others don’t. If you’re unhappy with a tester you can simply avoid choosing them again in future tests. Just as a tester can avoid applying for a test with a designer they didn’t ‘gel with’ in a previous tester call. I know we all have lists of testers/designers we’d rather not work with again.

I agree with most of what you said, though this I do not think is really effective. Sure, if you’ve conducted testing calls in the past, you might know from experience whether or not a specific person ‘gels with you’ better, but that assumes that you already have experience with multiple testers/designers. It also doesn’t really prevent future experiences with other testers who don’t gel well. My idea isn’t a miracle fix or anything, but I do think it can reduce the apprehension of selecting new testers you’ve never worked with before, so maybe you’ll have a higher chance of working better with the ones you pick.

Another thing I’ve noticed is a lot of posts and comments related to testers. Whilst I agree there are some testers who do the wrong thing - don’t complete the test on time, don’t provide feedback on problems with the pattern, even when they’re glaringly obvious to others, only want a free pattern and don’t really focus on testing the pattern etc, there is also a problem with some pattern designers.

This is a great addition. I had considered this as well but left it out of the post because, well, like I said, fear of talking to much essentially.

If you were to have a survey for the designers to complete regarding testers, there should also be a survey for testers to complete regarding the designers. Questions to consider for that survey could include:
Did you feel the designer was open to your suggestions?
Did the designer use any of your suggestions?
Did the designer communicate effectively?
Were any issues with the pattern corrected by the designer?

These are great suggestions as well. Testers should also have an idea of the designer.

I see now how extremely complicated this idea in its entirety would be to put into effect. Though I do think some elements in it are worth considering anyway.

3 Likes
8

You know, maybe a simple ‘were you satisfied with your experience with this tester/designer?’ would suffice

2 Likes
9

Very true.

I guess what I’m trying to convey is that, because we all have different expectations from testers/designers and we all interpret things differently, I feel that a survey similar to the one proposed, may not be the answer. Testing is, I believe, supposed to be an enjoyable experience for everyone involved. Having this sort of survey, for me, makes testing less appealing.

2 Likes
10

Yes, that’s also an alternative.

2 Likes
11

Thank you for the additional information. :smiley:

2 Likes
12

I love this idea!

2 Likes
13

i would love this idea!! especially the tester rating system hehe

2 Likes
14

that does sound like a great idea!

1 Like