Friday, 30 September 2022

New top story on Hacker News: Ask HN: Has the Apple Silicon excessive disk read/write issue been fixed?

New top story on Hacker News: Ask HN: Has the Apple Silicon excessive disk read/write issue been fixed?

Ask HN: Has the Apple Silicon excessive disk read/write issue been fixed?
29 by cool_hw | 9 comments on Hacker News.
This was a discussion when M1 macbooks were launched, and Apple supposedly addressed it in an OS update (macOS 11.4). But I'm seeing really high read/write numbers. I'm aware that SSD lifespans are long and TBW spec is pretty generous. Still, compared to my linux machines, this seems extraordinarily high. On my newish M1 MBA, with the latest updates, with barely any use, 98%+ sleep, I'm seeing about 3 to 5 GB reads per day and 2 to 4 GB writes per day. Latest report from smartctl. ---------------------------------------------------- === START OF SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED SMART/Health Information (NVMe Log 0x02) Critical Warning: 0x00 Temperature: 27 Celsius Available Spare: 100% Available Spare Threshold: 99% Percentage Used: 0% Data Units Read: 716,195 [366 GB] Data Units Written: 616,232 [315 GB] Host Read Commands: 9,108,273 Host Write Commands: 6,947,397 Controller Busy Time: 0 Power Cycles: 95 Power On Hours: 5 Unsafe Shutdowns: 11 Media and Data Integrity Errors: 0 Error Information Log Entries: 0 ---------------------------------------------------- M1 Air 16GB 1TB. Is this normal?

Thursday, 29 September 2022

Wednesday, 28 September 2022

Tuesday, 27 September 2022

Monday, 26 September 2022

Sunday, 25 September 2022

New top story on Hacker News: Ask HN: Books on designing disk-optimized data structures?

New top story on Hacker News: Ask HN: Books on designing disk-optimized data structures?

Ask HN: Books on designing disk-optimized data structures?
4 by memset | 2 comments on Hacker News.
Are there canonical books, resources, or readings for how to design data structures that will be primarily read and written to a disk rather than memory? Most of what I learned in school about big-O assumes that, for example, random access is O(1). However, random disk reads are really slow due to spacial locality. People who write databases obviously have solutions to this problem - for example, DuckDB is based on a number of papers that have come out over the years on this topic. If I wanted to design, ie, a tree structure which was intended to be read/written from a disk, are there general principles or patterns the have been developed to take advantage of locality of reference, minimize random reads, or decrease the overhead of writes, that I could familiarize myself with? What is the CLRS for disk?

Saturday, 24 September 2022

Friday, 23 September 2022

Thursday, 22 September 2022

Wednesday, 21 September 2022

New top story on Hacker News: Show HN: TaskTXT, plain text task-timing notepad

New top story on Hacker News: Show HN: TaskTXT, plain text task-timing notepad

Show HN: TaskTXT, plain text task-timing notepad
10 by trafnar | 6 comments on Hacker News.
I built TaskTXT.com based on my experience timing my tasks. I found that committing to a task before I start helps with my focus, and guessing how long it will take, then timing it prevents me from wanting to give in to distractions because I'm "on the clock". Video Overview: https://www.youtube.com/watch?v=HOYO0c_D6w0 There's also a Mac app which you can download here: https://ift.tt/YbO3ZCs Video overview of the Mac app: https://www.youtube.com/watch?v=qMs-V5v5gZY But I didn't want the tool to be distracting, so its based on plain text. That means the UI is very familiar and you can use it for generic notes in any structure you like. When you work in TaskTXT you are working directly on its data format, I made a video about this concept here: https://www.youtube.com/watch?v=kZdBgVZn5NI I think this tool is uniquely suited for programmers, so I'd be interested to hear any feedback about the product, or its viability as a business.

New top story on Hacker News: Show HN: Tigris – the open source developer data platform for your next app

New top story on Hacker News: Show HN: Tigris – the open source developer data platform for your next app

Show HN: Tigris – the open source developer data platform for your next app
19 by ovaistariq | 0 comments on Hacker News.
Tigris is the first truly open source developer data platform with a simple yet powerful, unified API that spans search, event streaming, and transactional document store. It enables you to focus on building your applications and stop worrying about the data infrastructure.

Tuesday, 20 September 2022

New top story on Hacker News: I accidentally started a movement – Policing the Police by scraping court data

New top story on Hacker News: I accidentally started a movement – Policing the Police by scraping court data

I accidentally started a movement – Policing the Police by scraping court data
88 by kristintynski | 12 comments on Hacker News.
Almost 3 years ago, I posted a story of how a post I wrote about utilizing county level police data to "police the police" to r/privacy and hackernews. https://ift.tt/i5mnyWe The idea quickly evolved into a real goal, to make good on the promise of free and open policing data. By freeing policing data from antiquated and difficult-to-access county data systems, and compiling that data in a rigorous way, we could create a valuable new tool to level the playing field and help provide community oversight of police behavior and activity. In the almost 3 years since the first post, something amazing has happened. The idea turned into something real. Something called The Police Data Accessibility Project. (https://www.pdap.io) More than 2,000 people joined the initial community, and while those numbers dwindled after the initial excitement, a core group of highly committed and passionate folks remained. In these 3 years, this team has worked incredibly hard to lay the groundwork necessary to enable us to realistically accomplish the monumental data collection task ahead of us. Let me tell you a bit about what the team has accomplished in these 3 years. Established the community and identified volunteer leaders who were willing and able to assume consistent responsibility. -Gained a pro-bono law firm to assist us in navigating the legal waters. Arnold + Porter is our pro-bono law firm. -Arnold + Porter helped us to establish as a legal entity and apply for 501c3 status -501c3 status granted -We've carefully defined our goals and set a clear roadmap for the future -Hired first full-time staff. -PDAP was awarded a $250,000 grant by The Heinz Endowments So now, I'm asking for help, because scraping, cleaning, and validating 18,000 police departments is no easy task. The first is to join us and help the team. Perhaps you joined initially, realized we weren't organized yet, and left? Now is the time to come back. Or, maybe you are just hearing of it now. Either way, the more people we have working on this, the faster we can get this done. Those with scraping experience are especially needed. The second is to either donate, or help us spread the message. The more donations, the more data we can gather. I want to thank the r/privacy community especially. It was here that things really began. TL;DR: I accidentally started a movement from a blog post I wrote about policing the police with data. The movement turned into something real because of r/privacy and hackernews: (Police Data Accessibility Project). 3 years later, the groundwork has been laid, non-profit established, full-time staff hired, and $250,000 in grant money and donations so far! Scrapers so far Github https://ift.tt/jo6ImeG Discord if you would like to join the efforts: https://ift.tt/nzrf2XJ *This is US centric

Monday, 19 September 2022

Sunday, 18 September 2022

Saturday, 17 September 2022

Friday, 16 September 2022

New top story on Hacker News: Ask HN: Why is everything a SaaS product?

New top story on Hacker News: Ask HN: Why is everything a SaaS product?

Ask HN: Why is everything a SaaS product?
46 by kevivni | 43 comments on Hacker News.
I understand the advantages of Saas - transparent updates, cloud based, redundancy, subscriptions, scaling, unicorns etc. Why don't we have more businesses following the JetBrains model specially if the product is not a service that needs to run 24/7. I buy the product once and use it for perpetuity. If I want updates, I pay more. As a consumer, my data does not leave my perimeter, my data is not sold or used for ads and I am not hooking into a subscription that I am going to forget soon. 1) Personal photos and videos backup and viewer. - Just give me a cheap cloud for backup and a desktop app for viewing. 2) Personal budget - Just give me a desktop app that connects to my different accounts and gives me overview.

Thursday, 15 September 2022

New top story on Hacker News: Show HN: Cachegrand – a fast OSS Key-Value store built for modern hardware

New top story on Hacker News: Show HN: Cachegrand – a fast OSS Key-Value store built for modern hardware

Show HN: Cachegrand – a fast OSS Key-Value store built for modern hardware
22 by daniele_dll | 21 comments on Hacker News.
I am the author of the platform, happy to reply to any question you might have! It scales up really nicely thanks to a year of research and development of the hashtable implemented in cachegrand, on the hardware used for benchmarking, an AMD EPYC 7502P, it was able to reach up to 5mln GET QPS and 4.5mln SET QPS, with batching up to 60mln GET QPS and up to 26MLN SET QPS. cachegrand is fast, it's fully Open Source, it's under a BSD 3-clause license - it can be used easily as standalone platform or incorporated in other ones without any licensing issue - and we are working to expand the Redis functionalities supported and to impelement a tiered storage to cache more data than the available memory. Longer term our goal is to expand the support to different platforms (e.g. memcache, kafka, etc.), add support to webassembly to have user defined functions and server side events, and of course a network bypass (combining XDP and a lockless FreeBSD tcp/ip stack) and a storage bypass. Although it can easily used via docker, here a direct link to the latest release https://ift.tt/PjcenzO.... Currently we are focused on supporting Redis, here the list of commands currently implemented https://ift.tt/UTQKalf...

Wednesday, 14 September 2022

Tuesday, 13 September 2022

Monday, 12 September 2022

Sunday, 11 September 2022

New top story on Hacker News: Ask HN: Is there a precedent for legislation that mandates code changes to OSS?

New top story on Hacker News: Ask HN: Is there a precedent for legislation that mandates code changes to OSS?

Ask HN: Is there a precedent for legislation that mandates code changes to OSS?
7 by fsociety999 | 7 comments on Hacker News.
I was reading this post on HN earlier today about how the White House may consider executive action or legislation to ban Bitcoin mining: https://ift.tt/KhCAy51 When reading the linked article and the White House press release (https://ift.tt/jSYEWKQ), this particular section jumped out at me: > Should these measures prove ineffective at reducing impacts, the Administration should explore executive actions, and Congress might consider legislation, to limit or eliminate the use of high energy intensity consensus mechanisms for crypto-asset mining. I am curious if the U.S. government actually has that power. Would this be considered constitutional? I can understand issuing penalties or otherwise stepping in to regulate businesses, but considering Bitcoin is an open-source, community driven software project (and so are many other crypto projects), can the government enforce that the software has to be written a certain way? Would this be considered a violation of the First Amendment? I am sure in this specific case many people may agree with the intentions or believe that this change is not a problem, but the precedent to me is pretty scary. Imagine if in the future, rich and powerful people can lobby the government to limit or crush any open-source software they want if they feel like it poses a threat to an existing company or industry. Based on this article, it sounds like code is considered free speech: https://ift.tt/gtWTdl8

Saturday, 10 September 2022

Friday, 9 September 2022

Thursday, 8 September 2022

Wednesday, 7 September 2022

Tuesday, 6 September 2022

Monday, 5 September 2022

Sunday, 4 September 2022

Saturday, 3 September 2022

Friday, 2 September 2022

Thursday, 1 September 2022