Class
Assault Situation
Steerage
Immediate Assaults: Crafting adversarial prompts that permit an adversary to affect the conduct of the mannequin, and therefore the output in ways in which weren’t supposed by the appliance.
Immediate injections which might be invisible to victims and alter the state of the sufferer’s account or or any of their property.
In Scope
Immediate injections into any instruments by which the response is used to make selections that straight have an effect on sufferer customers.
In Scope
Immediate or preamble extraction by which a consumer is ready to extract the preliminary immediate used to prime the mannequin solely when delicate info is current within the extracted preamble.
In Scope
Utilizing a product to generate violative, deceptive, or factually incorrect content material in your personal session: e.g. ‘jailbreaks’. This consists of ‘hallucinations’ and factually inaccurate responses. Google’s generative AI merchandise have already got a devoted reporting channel for a lot of these content material points.
Out of Scope
Coaching Knowledge Extraction: Assaults which might be in a position to efficiently reconstruct verbatim coaching examples that include delicate info. Additionally known as membership inference.
Coaching knowledge extraction that reconstructs gadgets used within the coaching knowledge set that leak delicate, personal info.
In Scope
Extraction that reconstructs nonsensitive/public info.
Out of Scope
Manipulating Fashions: An attacker in a position to covertly change the conduct of a mannequin such that they’ll set off pre-defined adversarial behaviors.
Adversarial output or conduct that an attacker can reliably set off through particular enter in a mannequin owned and operated by Google (“backdoors”). Solely in-scope when a mannequin’s output is used to alter the state of a sufferer’s account or knowledge.
In Scope
Assaults by which an attacker manipulates the coaching knowledge of the mannequin to affect the mannequin’s output in a sufferer’s session in accordance with the attacker’s desire. Solely in-scope when a mannequin’s output is used to alter the state of a sufferer’s account or knowledge.
In Scope
Adversarial Perturbation: Inputs which might be supplied to a mannequin that leads to a deterministic, however extremely sudden output from the mannequin.
Contexts by which an adversary can reliably set off a misclassification in a safety management that may be abused for malicious use or adversarial achieve.
In Scope
Contexts by which a mannequin’s incorrect output or classification doesn’t pose a compelling assault state of affairs or possible path to Google or consumer hurt.
Out of Scope
Mannequin Theft / Exfiltration: AI fashions typically embrace delicate mental property, so we place a excessive precedence on defending these property. Exfiltration assaults permit attackers to steal particulars a couple of mannequin comparable to its structure or weights.
Assaults by which the precise structure or weights of a confidential/proprietary mannequin are extracted.
In Scope
Assaults by which the structure and weights aren’t extracted exactly, or once they’re extracted from a non-confidential mannequin.
Out of Scope
When you discover a flaw in an AI-powered software aside from what’s listed above, you’ll be able to nonetheless submit, supplied that it meets the {qualifications} listed on our program web page.
A bug or conduct that clearly meets our {qualifications} for a legitimate safety or abuse challenge.
In Scope
Utilizing an AI product to do one thing doubtlessly dangerous that’s already attainable with different instruments. For instance, discovering a vulnerability in open supply software program (already attainable utilizing publicly-available static evaluation instruments) and producing the reply to a dangerous query when the reply is already accessible on-line.
Out of Scope
As in line with our program, points that we already find out about aren’t eligible for reward.
Out of Scope
Potential copyright points: findings by which merchandise return content material showing to be copyright-protected. Google’s generative AI merchandise have already got a devoted reporting channel for a lot of these content material points.
Out of Scope
