• 0 Posts
  • 26 Comments
Joined 3 years ago
cake
Cake day: July 3rd, 2023

help-circle


  • Definitely. It might require significantly more input to gain the same certainty, but all it’s doing is reweighting the possible next tokens before choosing, and code output is still just token output. The rigid syntaxes probably means that the next token probabilities are much more sharply divided (maybe a random sentence the top 1 choice is just 40%, top 3 are 80%, but for a line of code, the top 1 choice might be 90% probability and top 3 hit 99%)









  • No that makes a ton of sense. I do definitely worry that you’re taking on too many complex adjacent things at once then. I myself use docker containers inside WSL to do dev work with Git and all these various things on a daily basis, but it took me a few years to feel comfortable like this. I think I would suggest you focus on the coding (python, javascript, etc etc) first and if it’s something that you can do in windows using just vscode, thats going to have less friction than trying to learn git at the same time as trying to learn command-line Linux. And once you feel comfortable with vscoding in windows, swap over to vscode in wsl, that way the IDE (vscode) is still familiar, but now you’re layering on the next level. And honestly, Git is pretty low on the stuff to learn. I know entire companies that do software version ingredients and sharing via email (aka, when Bob updates code he and Alice both use, he just emails her a copy) crazy, but it works for them.

    On the other hand, this Odin project looks pretty well set up so that maybe after a couple weeks of feeling terrible, you pop out on the other side where it took me years to get to!






  • If your argument was one of cost, you should have said so from the start! Economically, it might or might not make sense. I can’t pretend to know the economics of running a space based datacenter, I’ve never run a ground based datacenter.

    But you have been arguing about power and electricity and heat and how proud you are to have 200a service at your house (congrats on owning it, btw, tough nowadays) but those aren’t the dealbreakers. If the AI bros want to lose billions putting the datacenters in space, I don’t have a huge problem with that. Better that than diddling kids and destroying society, which is what they seem to be spending their money on now.


  • You don’t use 48 kW you have 48kW capacity, that’d be 33 (1500W) electric space heaters running nonstop 24/7. I have electric heat, electric oven/range, and an electric car and I averaged 3 kW across the last week. (406 kWh between the 26th and 1st)

    A comparison that is reasonable is an h100 rack cluster like this which uses about 60 kW per rack. For input power, the newer iROSA solar panels generate about 20 kW at a size of 20ft x 60ft each. Throw in 4 of those radiators, and you have something that is feasible to throw into space. Again, I can’t judge the economics of launching and running a space based datacenter business, but you could absolutely launch and operate a space rack with current tech.



  • That was my stumbling block, too. Don’t think of it as taking a datacenter and putting it into space whole, think of it as taking 5 or 10 racks and putting that into space, and repeating till you have as much compute as a datacenter. So it’s basically the size of a schoolbus (same size as hubble telescope) and it has solar panels+ heat rejection like those of the ISS, and then bolt a starlink on the end, and you can put as many of those in orbit as you need.

    Each part of the hardware is doable(ish), and if the nerds who actually run datacenters say the terrestrial energy/cooling cost numbers vs launch cost numbers make sense, I’m inclined to believe them even if I don’t get to see that math specifically. But right now it’s just AI bros saying the costs make sense, and I don’t as much believe them.


  • I used to think space data centers was a scam, but I learned how much power existing satellites already use (and thus must be able to radiate into space to keep cold), and just looking at the ISS, each radiator (and it has several) can reject 14 kW into space, so if the ISS has can safely generate 14 kW of electricity and reject all the waste heat, then the major concern for me is addressed. Space datacenters are the first step to industry, in space, which is an necessary step for a lot of future stuff.

    All the above is beyond the point though, he’s playing shell games to tie his most valuable and critical company, SpaceX, to the trashheap of AI bullshit so that the government will bail him out when it crashes.