Fuzzy Consensus Algorithm
Fuzzy Consensus
Algorithm
Proof-of-Skill Protocol
To ensure accurate proof-of-skill, we rely on our fuzzy consensus algorithm. Here's how it works:
When a candidate takes a skill-assessment for a particular skill, instead of relying on a single judgment, we collect evaluations from 3 Skill Validators. Each Skill Validator assesses their design skills & assigns a skill-level between Novice, Beginner, Intermediate, Proficient, Expert.
We apply our fuzzy consensus algorithm to these assessments to issue proof-of-skill, ensuring they are precise, impartial, and dependable. Here's how the fuzzy consensus algorithm works:
When an evaluator chooses a skill level, it doesn't just lock into that level. We assign a fuzzy value, meaning the chosen level gets the most weight, and neighboring levels get partial credit. This helps account for small differences in how evaluators perceive helps account for small differences in how evaluators perceive skills.
We then aggregate these fuzzy values across assessments of 3 Skill Validators. The level with the highest combined score becomes the designer's official skill level, ensuring a balanced and nuanced view of their abilities.
To ensure accurate proof-of-skill, we rely on our fuzzy consensus algorithm. Here's how it works:
When a candidate takes a skill-assessment for a particular skill, instead of relying on a single judgment, we collect evaluations from 3 Skill Validators. Each Skill Validator assesses their design skills & assigns a skill-level between Novice, Beginner, Intermediate, Proficient, Expert.
We apply our fuzzy consensus algorithm to these assessments to issue proof-of-skill, ensuring they are precise, impartial, and dependable. Here's how the fuzzy consensus algorithm works:
When an evaluator chooses a skill level, it doesn't just lock into that level. We assign a fuzzy value, meaning the chosen level gets the most weight, and neighboring levels get partial credit. This helps account for small differences in how evaluators perceive helps account for small differences in how evaluators perceive skills.
We then aggregate these fuzzy values across assessments of 3 Skill Validators. The level with the highest combined score becomes the designer's official skill level, ensuring a balanced and nuanced view of their abilities.
How Proof-of-Skill is Issued
How Proof-of-Skill is Issued
Example: Fuzzy Consensus for 'Designing User Flows'
Let's say we have 7 evaluators who rate a designer's skill in Designing User Flows. Here are their chosen levels: Skill Validator 1: Intermediate Skill Validator 2: Proficient Skill Validator 3: Beginner Skill Validator 4: Intermediate Skill Validator 5: Expert Skill Validator 6: Proficient Skill Validator 7: Beginner In our fuzzy system: Each chosen level gets a value of 1. The levels just above and below get a fuzzy value of 0.5. After aggregating these fuzzy values, we get the following totals: Novice: 0.5 + 0.5 = 1.0 Beginner: 1 + 1 + 1 + 0.5 + 0.5 = 4.0 Intermediate: 0.5 + 0.5 + 1 + 0.5 + 1 + 0.5 = 4.0 Proficient: 0.5 + 1 + 0.5 + 0.5 + 1 + 1 = 4.5 Expert: 0.5 + 1 + 0.5 = 2.0 Based on this aggregation, the designer's skill level is determined as Proficient the highest combined score.
How Skill Validator Selection Works
When someone shows interest in being a Skill Validator, we run a hygiene check: We review their LinkedIn profile to verify professional experience. We conduct a short call to understand their background. Next, their evaluation abilities are tested by having them review the same 4 assignments that have also been evaluated by hundreds of other design experts across multiple UI Design, UX Design, and Fundamental Design Skills. Their assessments are processed through the fuzzy consensus algorithm for all skills they have assessed, resulting in a unique credibility score for each Skill Validator aspirant. The higher the credibility score, the more closely one is aligned with the overall consensus on the candidates' skill levels for those 4 assignments. Only those with a credibility score above a defined threshold become Skill Validators—trusted experts who can accurately assess others' skills.
Made in
with
Backed by
Proof-of-Skill
Let's say we have 7 evaluators who rate a designer's skill in Designing User Flows. Here are their chosen levels:
Skill Validator 1: Intermediate
Skill Validator 2: Proficient
Skill Validator 3: Beginner
Skill Validator 4: Intermediate
Skill Validator 5: Expert
Skill Validator 6: Proficient
Skill Validator 7: Beginner
In our fuzzy system:
Each chosen level gets a value of 1.
The levels just above and below get a fuzzy value of 0.5.
After aggregating these fuzzy values, we get the following totals:
Novice: 0.5 + 0.5 = 1.0
Beginner: 1 + 1 + 1 + 0.5 + 0.5 = 4.0
Intermediate: 0.5 + 0.5 + 1 + 0.5 + 1 + 0.5 = 4.0
Proficient: 0.5 + 1 + 0.5 + 0.5 + 1 + 1 = 4.5
Expert: 0.5 + 1 + 0.5 = 2.0
Based on this aggregation, the designer's skill level is determined as Proficient the highest combined score.
Example: Fuzzy Consensus for 'Designing User Flows'
When someone shows interest in being a Skill Validator, we run a hygiene check:
We review their LinkedIn profile to verify professional experience.
We conduct a short call to understand their background.
Next, their evaluation abilities are tested by having them review the same 4 assignments that have also been evaluated by hundreds of other design experts across multiple UI Design, UX Design, and Fundamental Design Skills.
Their assessments are processed through the fuzzy consensus algorithm for all skills they have assessed, resulting in a unique credibility score for each Skill Validator aspirant. The higher the credibility score, the more closely one is aligned with the overall consensus on the candidates' skill levels for those 4 assignments.
Only those with a credibility score above a defined threshold become Skill Validators—trusted experts who can accurately assess others' skills.
How Skill Validator Selection
Works
Made in
with
Backed by
Proof-of-Skill