-
Notifications
You must be signed in to change notification settings - Fork 103
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Variable stake and randomized leader selection #2638
Merged
Merged
Changes from 1 commit
Commits
Show all changes
9 commits
Select commit
Hold shift + click to select a range
d9b5520
implement leader selection functions
ss-es b4456af
address comments
ss-es 05d9d4a
Merge branch 'main' into ss/variable-stake
ss-es f0a866c
Merge branch 'main' into ss/variable-stake
ss-es e71b39d
integrate into membership
ss-es a83df2b
fix
ss-es eb5fbca
clippy
ss-es ccb810f
update randomized committee to use DRB
ss-es 9c9a62e
add tests with fake DRB
ss-es File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -7,8 +7,12 @@ | |
//! The election trait, used to decide which node is the leader and determine if a vote is valid. | ||
use std::{collections::BTreeSet, fmt::Debug, num::NonZeroU64}; | ||
|
||
use sha2::{Digest, Sha256, Sha512}; | ||
|
||
use crate::traits::signature_key::StakeTableEntryType; | ||
use async_trait::async_trait; | ||
use hotshot_utils::anytrace::Result; | ||
use primitive_types::{U256, U512}; | ||
|
||
use super::node_implementation::NodeType; | ||
use crate::{traits::signature_key::SignatureKey, PeerConfig}; | ||
|
@@ -153,3 +157,78 @@ pub trait Membership<TYPES: NodeType>: Debug + Send + Sync { | |
None | ||
} | ||
} | ||
|
||
/// Calculate `xor(drb.cycle(), public_key)`, returning the result as a vector of bytes | ||
fn cyclic_xor(drb: [u8; 32], public_key: Vec<u8>) -> Vec<u8> { | ||
let drb: Vec<u8> = drb.to_vec(); | ||
|
||
let mut result: Vec<u8> = vec![]; | ||
|
||
for (drb_byte, public_key_byte) in public_key.iter().zip(drb.iter().cycle()) { | ||
result.push(drb_byte ^ public_key_byte); | ||
} | ||
|
||
result | ||
} | ||
|
||
/// Generate the stake table CDF, as well as a hash of the resulting stake table | ||
pub fn generate_stake_cdf<Key: SignatureKey, Entry: StakeTableEntryType<Key>>( | ||
mut stake_table: Vec<Entry>, | ||
drb: [u8; 32], | ||
) -> (Vec<(Entry, U256)>, [u8; 32]) { | ||
// sort by xor(public_key, drb_result) | ||
stake_table.sort_by(|a, b| { | ||
cyclic_xor(drb, a.public_key().to_bytes()).cmp(&cyclic_xor(drb, b.public_key().to_bytes())) | ||
}); | ||
|
||
let mut hasher = Sha256::new(); | ||
|
||
let mut cumulative_stake = U256::from(0); | ||
let mut cdf = vec![]; | ||
|
||
for entry in stake_table { | ||
cumulative_stake += entry.stake(); | ||
hasher.update(entry.public_key().to_bytes()); | ||
|
||
cdf.push((entry, cumulative_stake)); | ||
} | ||
|
||
(cdf, hasher.finalize().into()) | ||
} | ||
|
||
/// select the leader for a view | ||
/// | ||
/// # Panics | ||
/// Panics if the cdf is empty | ||
pub fn select_randomized_leader<SignatureKey, Entry: StakeTableEntryType<SignatureKey> + Clone>( | ||
cdf: Vec<(Entry, U256)>, | ||
stake_table_hash: [u8; 32], | ||
drb: [u8; 32], | ||
view: u64, | ||
) -> Entry { | ||
// We hash the concatenated drb, view and stake table hash. | ||
let mut hasher = Sha512::new(); | ||
hasher.update(drb); | ||
hasher.update(view.to_le_bytes()); | ||
hasher.update(stake_table_hash); | ||
let raw_breakpoint: [u8; 64] = hasher.finalize().into(); | ||
|
||
// then calculate the remainder modulo the total stake as a U512 | ||
let remainder: U512 = | ||
U512::from_little_endian(&raw_breakpoint) % U512::from(cdf.last().unwrap().1); | ||
|
||
// and drop the top 32 bytes, downcasting to a U256 | ||
let breakpoint: U256 = { | ||
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Should we use this instead? |
||
let mut result = [0u8; 64]; | ||
|
||
remainder.to_little_endian(&mut result); | ||
|
||
U256::from_little_endian(&result[32..64]) | ||
}; | ||
|
||
// now find the first index where the breakpoint is strictly smaller than the cdf | ||
let index = cdf.partition_point(|(_, cumulative_stake)| breakpoint < *cumulative_stake); | ||
|
||
// and return the corresponding entry | ||
cdf[index].0.clone() | ||
} |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
shouldn't this be a method of stake table struct or trait, something like
StakeTable.next_leader()
?There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes, it will be! I wanted to separate the raw logic into its own function, but the trait that handles the stake table will implement leader selection by calling this.
we just have multiple implementations that may or may not use this leader selection for tests etc
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I ended up just creating a wrapper type for all the DRB-related information we want to store between views, and the implementation now uses this opaquely!