▲ 693 ▼ Workers at NASA Told to ‘Drop Everything’ to Scrub Mentions of Indigenous People, Women from Its Websites (www.404media.co) submitted 2 years ago by schizoidman@lemm.ee to c/technology@lemmy.world 94 comments fedilink hide all child comments cross-posted from: https://ponder.cat/post/1517787
[–] IllNess@infosec.pub 213 points 2 years ago (10 children) If you have the funds, please support Internet Archives. permalink fedilink source hideshow 10 child comments replies: [–] stardust@lemmy.ca 108 points 2 years ago (8 children) With internet archive head quarters being in the US what would happen if the administration went after them? Would people from other countries be able to keep the project going? permalink fedilink source parent hideshow 8 child comments replies: [–] bobs_monkey@lemm.ee 58 points 2 years ago (3 children) That's unfortunately a very valid point. Iirc the big problem IA has is the sheer amount of disk space required to store everything. permalink fedilink source parent hideshow 3 child comments replies: [–] __nobodynowhere@sh.itjust.works 26 points 2 years ago (2 children) I wish I had the necessary petabytes of storage to at least store an offline copy. I wonder how many disks that would be and how redundant disks you'd need. permalink fedilink source parent hideshow 2 child comments replies: [–] bobs_monkey@lemm.ee 34 points 2 years ago (1 child) Here's this from 2021. They say they have about 200PB of raw storage across some 20k spinning drives at the time of writing (with more being added constantly, about 25%/yr), and capacities are mixed from 4TB to 16TB, across 750 servers housed on about 75 racks. I have 6x16TB WD red pros that ran me about $355/ea new with tax, and my bill was a smidge over $2100. Assuming you used all 16TB, you'd need about 12,500 16TB disks, which would run you about $4,437,500 without a bulk discount. How much of that is redundancy I'm not sure, but that's just HDDs, not the hardware to actually run everything between storage enclosures, OS, disks, memory, clustering, etc. They say they say a single copy with 16TB drives would be about 15 racks., but how that breaks down I'm not sure. permalink fedilink source parent hideshow 1 child comment replies: [–] Petter1@lemm.ee 12 points 2 years ago* I once made this calculation for a database of 700Tb, even that blew my mind 🤣 permalink fedilink source parent [–] Petter1@lemm.ee 31 points 2 years ago* (2 children) We need to distribute all that data, for the sake of history in the future. Data hoarding and torrenting is a service to humanity. permalink fedilink source parent hideshow 2 child comments replies: [–] echodot@feddit.uk 11 points 2 years ago (1 child) Not just data but in important scientific research too. The republicans want to drive the US back to the stone age, because that's when they were last relevant. permalink fedilink source parent hideshow 1 child comment replies: [–] Petter1@lemm.ee 4 points 2 years ago 😇 in my mind, I included those datasets in data But sure! I agree! We need free and open science, worldwide People need to understand the art of scientific thinking permalink fedilink source parent [–] TachyonTele@lemm.ee 2 points 2 years ago Depends on what the cops would do. permalink fedilink source parent [–] BlastboomStrice@mander.xyz 3 points 2 years ago Just did yesterday after putting it off for some months permalink fedilink source parent
[–] stardust@lemmy.ca 108 points 2 years ago (8 children) With internet archive head quarters being in the US what would happen if the administration went after them? Would people from other countries be able to keep the project going? permalink fedilink source parent hideshow 8 child comments replies: [–] bobs_monkey@lemm.ee 58 points 2 years ago (3 children) That's unfortunately a very valid point. Iirc the big problem IA has is the sheer amount of disk space required to store everything. permalink fedilink source parent hideshow 3 child comments replies: [–] __nobodynowhere@sh.itjust.works 26 points 2 years ago (2 children) I wish I had the necessary petabytes of storage to at least store an offline copy. I wonder how many disks that would be and how redundant disks you'd need. permalink fedilink source parent hideshow 2 child comments replies: [–] bobs_monkey@lemm.ee 34 points 2 years ago (1 child) Here's this from 2021. They say they have about 200PB of raw storage across some 20k spinning drives at the time of writing (with more being added constantly, about 25%/yr), and capacities are mixed from 4TB to 16TB, across 750 servers housed on about 75 racks. I have 6x16TB WD red pros that ran me about $355/ea new with tax, and my bill was a smidge over $2100. Assuming you used all 16TB, you'd need about 12,500 16TB disks, which would run you about $4,437,500 without a bulk discount. How much of that is redundancy I'm not sure, but that's just HDDs, not the hardware to actually run everything between storage enclosures, OS, disks, memory, clustering, etc. They say they say a single copy with 16TB drives would be about 15 racks., but how that breaks down I'm not sure. permalink fedilink source parent hideshow 1 child comment replies: [–] Petter1@lemm.ee 12 points 2 years ago* I once made this calculation for a database of 700Tb, even that blew my mind 🤣 permalink fedilink source parent [–] Petter1@lemm.ee 31 points 2 years ago* (2 children) We need to distribute all that data, for the sake of history in the future. Data hoarding and torrenting is a service to humanity. permalink fedilink source parent hideshow 2 child comments replies: [–] echodot@feddit.uk 11 points 2 years ago (1 child) Not just data but in important scientific research too. The republicans want to drive the US back to the stone age, because that's when they were last relevant. permalink fedilink source parent hideshow 1 child comment replies: [–] Petter1@lemm.ee 4 points 2 years ago 😇 in my mind, I included those datasets in data But sure! I agree! We need free and open science, worldwide People need to understand the art of scientific thinking permalink fedilink source parent [–] TachyonTele@lemm.ee 2 points 2 years ago Depends on what the cops would do. permalink fedilink source parent
[–] bobs_monkey@lemm.ee 58 points 2 years ago (3 children) That's unfortunately a very valid point. Iirc the big problem IA has is the sheer amount of disk space required to store everything. permalink fedilink source parent hideshow 3 child comments replies: [–] __nobodynowhere@sh.itjust.works 26 points 2 years ago (2 children) I wish I had the necessary petabytes of storage to at least store an offline copy. I wonder how many disks that would be and how redundant disks you'd need. permalink fedilink source parent hideshow 2 child comments replies: [–] bobs_monkey@lemm.ee 34 points 2 years ago (1 child) Here's this from 2021. They say they have about 200PB of raw storage across some 20k spinning drives at the time of writing (with more being added constantly, about 25%/yr), and capacities are mixed from 4TB to 16TB, across 750 servers housed on about 75 racks. I have 6x16TB WD red pros that ran me about $355/ea new with tax, and my bill was a smidge over $2100. Assuming you used all 16TB, you'd need about 12,500 16TB disks, which would run you about $4,437,500 without a bulk discount. How much of that is redundancy I'm not sure, but that's just HDDs, not the hardware to actually run everything between storage enclosures, OS, disks, memory, clustering, etc. They say they say a single copy with 16TB drives would be about 15 racks., but how that breaks down I'm not sure. permalink fedilink source parent hideshow 1 child comment replies: [–] Petter1@lemm.ee 12 points 2 years ago* I once made this calculation for a database of 700Tb, even that blew my mind 🤣 permalink fedilink source parent
[–] __nobodynowhere@sh.itjust.works 26 points 2 years ago (2 children) I wish I had the necessary petabytes of storage to at least store an offline copy. I wonder how many disks that would be and how redundant disks you'd need. permalink fedilink source parent hideshow 2 child comments replies: [–] bobs_monkey@lemm.ee 34 points 2 years ago (1 child) Here's this from 2021. They say they have about 200PB of raw storage across some 20k spinning drives at the time of writing (with more being added constantly, about 25%/yr), and capacities are mixed from 4TB to 16TB, across 750 servers housed on about 75 racks. I have 6x16TB WD red pros that ran me about $355/ea new with tax, and my bill was a smidge over $2100. Assuming you used all 16TB, you'd need about 12,500 16TB disks, which would run you about $4,437,500 without a bulk discount. How much of that is redundancy I'm not sure, but that's just HDDs, not the hardware to actually run everything between storage enclosures, OS, disks, memory, clustering, etc. They say they say a single copy with 16TB drives would be about 15 racks., but how that breaks down I'm not sure. permalink fedilink source parent hideshow 1 child comment replies: [–] Petter1@lemm.ee 12 points 2 years ago* I once made this calculation for a database of 700Tb, even that blew my mind 🤣 permalink fedilink source parent
[–] bobs_monkey@lemm.ee 34 points 2 years ago (1 child) Here's this from 2021. They say they have about 200PB of raw storage across some 20k spinning drives at the time of writing (with more being added constantly, about 25%/yr), and capacities are mixed from 4TB to 16TB, across 750 servers housed on about 75 racks. I have 6x16TB WD red pros that ran me about $355/ea new with tax, and my bill was a smidge over $2100. Assuming you used all 16TB, you'd need about 12,500 16TB disks, which would run you about $4,437,500 without a bulk discount. How much of that is redundancy I'm not sure, but that's just HDDs, not the hardware to actually run everything between storage enclosures, OS, disks, memory, clustering, etc. They say they say a single copy with 16TB drives would be about 15 racks., but how that breaks down I'm not sure. permalink fedilink source parent hideshow 1 child comment replies: [–] Petter1@lemm.ee 12 points 2 years ago* I once made this calculation for a database of 700Tb, even that blew my mind 🤣 permalink fedilink source parent
[–] Petter1@lemm.ee 12 points 2 years ago* I once made this calculation for a database of 700Tb, even that blew my mind 🤣 permalink fedilink source parent
[–] Petter1@lemm.ee 31 points 2 years ago* (2 children) We need to distribute all that data, for the sake of history in the future. Data hoarding and torrenting is a service to humanity. permalink fedilink source parent hideshow 2 child comments replies: [–] echodot@feddit.uk 11 points 2 years ago (1 child) Not just data but in important scientific research too. The republicans want to drive the US back to the stone age, because that's when they were last relevant. permalink fedilink source parent hideshow 1 child comment replies: [–] Petter1@lemm.ee 4 points 2 years ago 😇 in my mind, I included those datasets in data But sure! I agree! We need free and open science, worldwide People need to understand the art of scientific thinking permalink fedilink source parent
[–] echodot@feddit.uk 11 points 2 years ago (1 child) Not just data but in important scientific research too. The republicans want to drive the US back to the stone age, because that's when they were last relevant. permalink fedilink source parent hideshow 1 child comment replies: [–] Petter1@lemm.ee 4 points 2 years ago 😇 in my mind, I included those datasets in data But sure! I agree! We need free and open science, worldwide People need to understand the art of scientific thinking permalink fedilink source parent
[–] Petter1@lemm.ee 4 points 2 years ago 😇 in my mind, I included those datasets in data But sure! I agree! We need free and open science, worldwide People need to understand the art of scientific thinking permalink fedilink source parent
[–] TachyonTele@lemm.ee 2 points 2 years ago Depends on what the cops would do. permalink fedilink source parent
[–] BlastboomStrice@mander.xyz 3 points 2 years ago Just did yesterday after putting it off for some months permalink fedilink source parent