• 0 Posts
  • 10 Comments
Joined 1 year ago
cake
Cake day: June 7th, 2023

help-circle
  • I think your job in your current form is likely in danger.

    SOTA Foundation Models like GPT4 and Gemini Ultra can write code, execute, and debug with special chain of thought prompting techniques, and large acale process verification on synthetic data and RL search for correct outputs will make this 10x better. The silver lining to this is that I expect this to require an absolute shit ton of compute to constantly generate LLM output hundreds of times for each internal prompt over multiple prompts, requiring immense compute and possibly taking longer than an ordinary software engineer to run. I suspect early full stack developer LLMs will mainly be used to do a few very tedious coding tasks and SWEs will be cheaper for a fair length of time.

    I expect it will be 2-3 years before this happens, so for that short period I expect workers to be “super-productive” by using LLMs in the coding process, but I expect the crossover point when the LLM becomes better is quite soon, perhaps in the next 5 years as compute requirements go down.


  • I suppose having worked with LLMs a whole bunch over the past year I have a better sense of what I meant by “automate high level tasks”.

    I’m talking about an assistant where, let’s say you need to edit a podcast video to add graphics and cut out dead space or mistakes that you corrected in the recording. You could tell the assistant to do that and it would open the video in Adobe Premiere pro, do the necessary tasks, then ask you to review it to check if it made mistakes.

    Or if you had an issue with a particular device, e.g. your display, the assistant would research the issue and perform the necessary steps to troubleshoot and fix the issue.

    These are currently hypothetical scenarios, but current GPT4 can already perform some of these tasks, and specifically training it to be a desktop assistant and to do more agentic tasks will make this a reality in a few years.

    It’s additionally already useful for reading and editing long documents and will only get better on this end. You can already use an LLM to query your documents and give you summaries or use them as instructions/research to aid in performing a task.


  • Current LLMs are manifestly different from Cortana (🤢) because they are actually somewhat intelligent. Microsoft’s copilot can do web search and perform basic tasks on the computer, and because of their exclusive contract with OpenAI they’re gonna have access to more advanced versions of GPT which will be able to do more high level control and automation on the desktop. It will 100% be useful for users to have this available, and I expect even Linux desktops will eventually add local LLM support (once consumer compute and the tech matures). It is not just glorified auto complete, it is actually fairly correlated with outputs of real human language cognition.

    The main issue for me is that they get all the data you input and mine it for better models without your explicit consent. This isn’t an area where open source can catch up without significant capital in favor of it, so we have to hope Meta, Mistral and government funded projects give us what we need to have a competitor.





  • Yeah there’s no way a viable Linux phone could be made without the ability to run Android apps.

    I think we’re probably at least a few years away from being able to daily drive Linux on modern phones with functioning things like NFC payments and a decent native app collection. It’s definitely coming but it has far less momentum than even the Linux desktop does.




  • I really hate the state of the Supreme Court atm. Looking back, it wasn’t a legitimate institution from the beginning, but the current 6-3 court shows how flawed it is, being out of line with public opinion in loads of different cases and effectively legislating from the bench via judicial review.

    The only reason it has gotten this bad, though, is because Congress has abdicated its responsibilities as a legislative body and left it more and more to executive orders and court decisions. The entire debate around the Dobbs decision could have been avoided if Dems codified abortion into law, and this one could have avoided too if our Congress actually went to work legislating a solution to the ongoing student loan and college affordability crisis.

    I think we need supreme court reform. I’m particularly partial to the idea of having a rotating bench pulled randomly from the lower courts each term, with each party in Congress getting a certain amount of strike outs to take people off that they don’t want, similar to the way jurors are selected. I also think the people should be able to overrule the court via referendum, because ultimately we should decide what the constitution says.

    I just can’t see this happening though, at least for multiple decades until the younger people today get into political power.