The human-in-the-loop approach reframes an automation problem as a Human-Computer Interaction (HCI) design problem.

1. Human in the Loop
learning and control
Nikita Lukianets, Founder

2. Buildingdecisionmodels
Perceive Decide Act Evaluate
What
information do
we have/need to
make decisions?
How do we
decide based on
received
information?
What do we do
once we have
our decision?
How do we
evaluate the
quality of our
decision?
Nikita Lukianets @nikiluk
Quantitative Ethics - governance and ethics of AI decisions

3. Buildingdecisionmodels
Perceive Decide Act Evaluate
What
information do
we have/need to
make decisions?
How do we
decide based on
received
information?
What do we do
once we have
our decision?
How do we
evaluate the
quality of our
decision?
Nikita Lukianets @nikiluk
Quantitative Ethics - governance and ethics of AI decisions

4. Buildingdecisionmodels
Perceive Decide Act Evaluate
What
information do
we have/need to
make decisions?
How do we
decide based on
received
information?
What do we do
once we have
our decision?
How do we
evaluate the
quality of our
decision?
Nikita Lukianets @nikiluk
Quantitative Ethics - governance and ethics of AI decisions
(better) (better) (better) (better)

5. Labeling: huge
amounts of
work…
SML training depends on data annotated by
subject-matter experts (Lawyers, Linguists, Doctors)
Nikita Lukianets @nikiluk
Quantitative Ethics - governance and ethics of AI decisions

6. WhytouseHuman-in-the-LoopML?
• Making Machine Learning models more accurate
• Getting Machine Learning to the desired accuracy faster
• Making humans more accurate
• Making humans more efficient

7. Learning Control
HITL = Supervised ML + Active
Learning
Focusing on smart annotation strategies Focusing on overall user experience and safety
Exploring validation configurations

8. Swarm Council Crowdsourcing Expert
1. Humans confirm
2.Humans advise
3.Machines confirm
4.Machines advise
HITLcontroldesign

9. OpenEthicsTransparencyProtocol

10. DoesHITLsetuprequirement
removeethicalconcerns?
Nikita Lukianets @nikiluk
Quantitative Ethics - governance and ethics of AI decisions

11. DoesHITLsetuprequirement
removeethicalconcerns?
No, it can shift responsibility,
but allows reassurance and
two-way communication.
Nikita Lukianets @nikiluk
Quantitative Ethics - governance and ethics of AI decisions

12. Nikita Lukianets
Twitter: nikiluk
https://openethics.ai/join
n.lukianets@openethics.ai
Discord: https://discord.gg/24jfS9U