Alexis Rondeau

Bookmarks

March 2024 · 119 bookmarks

Bookmarked from Amit Gupta @superamit

Got married last weekend to a woman like no other.

A woman who dated me after I slid into her DMs with a paul graham essay.

A woman who cried every single night that first week when we talked on the phone.

A woman who did reference calls to check me out before our first date.

A woman who booked a flight, a car, and an airbnb, flew two thousand miles, and quarantined for 3 days, to make that first date happen.

And a woman who, when my vows referenced sunk costs, commitment devices, and training LLMs to achieve immortality, laughed instead of cringed.

I’m so lucky to have you as my partner, my equal, and my teammate in life. I love you, @HuaNancy. ❤️

Bookmarked from Nikita Bier @nikitabier

“Community” is a fake term created by rookie social app founders. The vast majority of the examples they cite are just groups of people shilling things—or with other financial motivations (crypto, real estate, tech).

If you were to count all the people in real communities globally, you would find fewer than 20 million daily active commenters.

The average person stares at their phone in a catatonic state for 8 hours per day, has zero unique interests, and dies.

Bookmarked from Tim Ferriss @tferriss

On my coffee table at home, I have a piece of driftwood. Its sole purpose is to display a quote by Anaïs Nin, which I see every day:

“Life shrinks or expands in proportion to one’s courage.”

It’s a short reminder that success can usually be measured by the number of uncomfortable conversations we are willing to have, and by the number of uncomfortable actions we are willing to take.

Bookmarked from Lex Fridman @lexfridman

Here's my conversation with Annie Jacobsen (@anniejacobsen) all about nuclear war, CIA, Area 51, UFOs, and government secrecy. This was a terrifying and fascinating conversation.

It's here on X in full, and is up on YouTube, Spotify, and everywhere else. Links in comment.

Timestamps:
0:00 - Introduction
2:13 - Nuclear war
6:57 - Launch procedure
12:36 - Deterrence
16:09 - Tactical nukes
25:35 - Nuclear submarines
28:35 - Nuclear missiles
35:46 - Nuclear football
44:53 - Missile interceptor system
49:10 - North Korea
55:46 - Nuclear war scenarios
1:04:38 - Warmongers
1:09:06 - President's cognitive ability
1:15:19 - Refusing orders
1:23:17 - Russia and Putin
1:28:23 - Cyberattack
1:29:45 - Ground zero of nuclear war
1:34:24 - Surviving nuclear war
1:38:42 - Nuclear winter
1:49:05 - Alien civilizations
1:54:40 - Extrasensory perception
2:08:25 - Area 51
2:12:23 - UFOs and aliens
2:22:51 - Roswell incident
2:29:30 - CIA assassinations
2:48:23 - Navalny
2:50:48 - KGB
2:57:24 - Hitler and the atomic bomb
3:01:27 - War and human nature
3:04:53 - Hope

Bookmarked from Ayoub Moustaid @mstdayoub

The impact of localization on App Store Optimization.

App downloads nearly doubled after implementing localization📈

I included extra keywords across all secondary languages in the US store, which are: Arabic, Chinese (Simplified), Chinese (Traditional), French, Korean, Portuguese (Brazil), Russian, Spanish (Mexico), and Vietnamese.

The process is simple;
more localizations -> more keywords -> more reach -> more downloads

#aso #ios

Bookmarked from Sully @SullyOmarr

Kinda bonkers, but this agent workflow only cost me ~$0.09 (9 cents)

It's about ~ 350k tokens, and the outputs are on par with gpt-4, at a fraction of the price.

GPT = $10/1m = $3.50
Haiku = $0.25/1m = $0.09

40x cheaper.

This wasn't even possible 1 month ago.

Bookmarked from Yohei @yoheinakajima

25 files across 9 nested folders with functions that depend on each other, cleanly organized

created by AI based on auto-generated file descriptions which currently shrink 14k+ tokens (full code) down to about 6k tokens*

*this include param description for each function which I don't need for this (that's for later), so this could shrink to much less. (~15% of full code)

Bookmarked from Bindu Reddy @bindureddy

Quiet-STaR Gives AI An Inner Monologue

Quier-STaR teaches language models to think before they speak 🤣🤣

It's like giving an AI an inner monologue, and this approach improves common-sense reasoning but doubles math performance!!

While this is not exactly OpenAI's Q-star, it improves reasoning and math, just like OAI's Q-star, but more importantly, it is open-source.

Pretty sure, OpenAI's Q-star and GPT-5 use techniques like this one to improve reasoning in LLMs

Humans usually pause to think before writing or speaking. Similarly, with Quiet-STaR, LLMs learn to generate rationales at each token to explain the future text, improving their predictions.

The idea is to generate many inner rationales in parallel after every token to explain future text (think), mix future text predictions with and without rationales (talk), and then learn based on a reward mechanism. The reward mechanism teaches the LLM to learn the right rationales.

The Quiet-STaR method improves the Mistral 7B CommonsenseQA score from 36.3% to 47.2% (significant) and doubles its Gsm8K's (math) performance!!

The paper makes several contributions, including generalizing STaR to learn from diverse structured data, paralleling the algorithm to generate rationales from all token positions in a given string, introducing a mixing head to determine how much to incorporate the next-token prediction from a given thought into the current next-token prediction and show that a loss function that includes multiple tokens ahead for language modeling improves the effect of thinking.

The most important thing to note here is that the effects of Quiet-STaR may be much more powerful when applied to a more robust model and when trained from scratch.

OpenAI, Google, and other AI labs are undoubtedly trying techniques like these to improve reasoning on LLMs.

A big thank you to the authors of Quiet-STaR for publishing their research. With folks like them, we wouldn't have some crucial research ideas in the public domain.

Bookmarked from Virat Singh @virattt

My financial RAG dataset is live 🗃️

You all asked me to share the 100 question dataset.

So, here it is.

Dataset details:

  • 100 questions on Airbnb 2023 10-K
  • synthetically generated via opus

The dataset is tiny right now, but I will continue expanding it.

Eventually, I will upload it to HuggingFace.

Let me know what the best open source libraries are for economically generating datasets.

If none exist, I will build my own and share here 🙂

Bookmarked from Ruben Hassid @rubenhassid

Act like Simon Sinek, an influential thought leader and expert in organizational leadership.

With over 20 years of experience in studying and advising on business strategies, you are deeply familiar with the 'Golden Circle' theory, which emphasizes the importance of starting with 'Why' in business decision-making.

Your task is to analyze [The Concept of a company], through the lens of the Golden Circle framework.

Begin by exploring the core of the company's business strategy – its 'Why' in much deeper level. Investigate the company's mission, vision, and the underlying purpose that drives its business model.

Reflect on how the company's 'Why' resonates with its target audience and influences customer loyalty and brand advocacy.

Next, address the 'How' of the company's business model. Discuss the unique processes, technologies, and approaches the company uses to deliver its service.

Examine how these methods differentiate the company from competitors and contribute to its success.

Then, move to the 'What' aspect. Outline the specific services and features offered by the company.

Analyze how these offerings align with the company's core 'Why' and meet the needs of their users.

After completing this analysis, apply these insights to my business.

Provide a structured framework for me to input information about my business.

Ask me about the information about my business, focusing on the following:

My Business's 'Why': Guide me to articulate the business’s purpose, mission, and vision. Ask probing questions that help to deeply understand the motivation behind the business.

My Business's 'How': Encourage me to describe the unique processes, technologies, and strategies the business employs.

Focus on how these elements support my 'Why'.

My Business's 'What': Have me list the products or services, emphasizing how these offerings connect with my 'Why' and 'How'.

Finally, use the information provided about my business to offer tailored advice.

Provide actionable recommendations that align with my 'Why', optimize my 'How', and enhance my 'What'.

Constraints:

Ensure the analysis is specific to [The concept of a company] and does not generalize to other business types.

Avoid technical jargon that may be unclear to a non-specialist audience.

Include comparisons to other similar models in the same industry for context, but keep the focus on the company we are analyzing.

Highlight areas where the company excels and areas where it could potentially improve or innovate.

Take a deep breath and work on this problem step-by-step.

———

I added below my WHY (lol) & where is my library of prompts:

Bookmarked from Nick St. Pierre @nickfloats

Midjourney continues to reiterate in office hours that their goal is real-time world simulation.

They said:
"We're really trying to get to the world simulation. We're building 3D midjourney, video MJ, & real-time MJ where things move really really fast.

Put them all together, you have a world simulation. Goal is to build each of those 3 things separately, then bring them all together...

...it will be more of a sandbox. People will make video games in it, people will shoot movies in it, but the goal is to build the open world sandbox."

Bookmarked from Wes Kao 🏛 @wes_kao

Managing up 101: Make it insanely easy to give you feedback.

One of my direct reports sent this Slack DM and it's a masterclass in simple, direct communication.

No guessing where to find docs.

No follow-up questions on timing.

No confusion about priority levels.

She made it easy--and in less than 1 hour, I was able to provide feedback, give approval, and remove myself as the bottleneck for her projects.

Make it easy for people to give you what you want.

Bookmarked from BOSS @thebeautyofsaas

Nobody in this space gives enough attention to

Energy levels

Childlike curiosity

Two underrated factors for success

Possessing those two is a golden ticket

Not getting tired while others do

Having an infinite curiosity about relevant topics

Hard to beat when combined

Bookmarked from Sully @SullyOmarr

Just had the most surreal experience with AI + Coding

Most of my day to day llm use is around coding and I usually default to gpt4 since i use cursor ide,

The thing i was working was pretty dense, ~3000 LOC and 1 file had a weird bug

Usually i just ask LLM's in snippets (since they're pretty bad at large outputs), but i couldn't figure out the weird react rendering bug

Decided to copy and paste all 3 files and ask claude to fix it

i didn't really have high expectations since even with tons of files, most llms fail horribly at

but to my surprise, somehow, Claude was able to perfectly write the entire file (200 LOC) with 0 bugs

it had perfect coding style as well, worked first try.

i think just making better models with larger contexts is going to make devs more productive than an AI agent coding for you.

Instead of an autonomous agent trying to loop and debug, it's 10x faster if an engineer can just conduct

i'd rather have myself writing "high level" code so i can built infinitely more complicated software then an LLM coding "meh" hello world sites.

really excited to see what a model like 5 will be able to do.

there's actually so much to build

Bookmarked from James O'Leary @jpohhhh

Google Gemini integration began 15 minutes ago, this is a cope thread

  • There's an API called "Gemini API" that is free until we start charging for it early next year (it is mid-March)
  • Gemini Ultra will be available early next year (it is mid-March)
  • Gemini 1.5 waitlist
Bookmarked from Nick St. Pierre @nickfloats

Assignment: Generate a happy moment but make it seem sad

Prompt: emotional documentary closeup of a mother and son capturing the feeling of letting go. The mother, with watery eyes and a restrained smile, is kneeling, holding her son. In her eyes we see she's afraid to let go. The child, with his backpack slung over his shoulders, pulls away. In the background kids play on the colorful playground. Light and shadow create emotional tension as the child takes a step towards class. A photo of parental love, and the beauty and pain of letting go --ar 7:5 --style raw

Bookmarked from Matt Shumer @mattshumer_

Here’s a Claude 3 prompt that helps you learn any skill faster.

Just give it a skill, and it’ll give you a custom curriculum:

—
<role>You are a learning coach renowned for your ability to help people master complex skills in record time. You have deep expertise in accelerated learning, deliberate practice, and skill acquisition.</role>

<task>Guide a learner through the process of rapidly acquiring a new complex skill. Break down the skill into key components, share techniques for deliberate practice, and provide a step-by-step roadmap to mastery. Offer motivation and troubleshooting tips to overcome obstacles.</task>

Respond using the following <response_format>:

<response_format>
<skill>The complex skill to be mastered</skill>

<subskills>Key component subskills that comprise the complex skill</subskills>

<deliberate_practice_techniques>Specific techniques for deliberate practice of each subskill</deliberate_practice_techniques>

<mastery_roadmap>Step-by-step roadmap from beginner to mastery</mastery_roadmap>

<obstacles>Common obstacles and plateaus in the skill acquisition process</obstacles>

<troubleshooting>Troubleshooting tips and techniques to overcome obstacles</troubleshooting>

<motivation>Motivational advice and encouragement for the skill acquisition journey</motivation>
</response_format>

<skill>[COMPLEX SKILL TO BE LEARNED]</skill>
—

Bookmarked from BOSS @thebeautyofsaas

Considering all the tech advancements in the next few yrs

Working on your social intelligence will be the ultimate move

How to be direct without being aggressive

How to lead things and speak clearly to get to the point

With these you will never have to worry about your job

Bookmarked from Ethan Mollick @emollick

In every group I speak to, from business executives to scientists, including a group of very accomplished people in Silicon Valley last night, much less than 20% of the crowd has even tried a GPT-4 class model.

Less than 5% has spent the required 10 hours to know how they tick.

Bookmarked from david rein @idavidrein

Claude 3 gets ~60% accuracy on GPQA. It's hard for me to understate how hard these questions are—literal PhDs (in different domains from the questions) with access to the internet get 34%.

PhDs in the same domain (also with internet access!) get 65% - 75% accuracy.

Bookmarked from Anthony Simon @anthonynsimon

"Let's do startups" - Germany edition

But first... some paperwork:

1. Put aside €25,000 for company formation
2. Find a notary to draft articles of incorporation (1-2 weeks)
3. Open bank account (4-6 weeks)
4. Deposit share capital and send to notary
5. Entry into commercial registry
6. Ignore official looking scam letters asking for money
7. Entry into transparency register
8. Register with local trade office
9. Register with tax office
10. Wait for your company's VAT ID
11. You need an official address (don't use your home, can't use PO box), so rent virtual office
12. Buy company insurance
13. Buy accounting software
14. Set up payroll (you have to employ yourself as manager)
15. Pay for on-going accounting costs (€2-3k a year)
16. Prepare monthly, quarterly and yearly taxes
17. Make sure you have a GDPR-compliant privacy policy, and DPAs with all service providers
18. Make sure you have a compliant legal notice on your website and emails, or risk getting a €50,000 fine
19. Make sure your invoices are actually compliant with regulations
20. Don't ever move out of Germany while owning the company, or else go bankrupt due to the exit-tax with no liquidity problem

Now you may invoice your first customer - if you dare ;)

(obviously not legal/tax advice, this is satire)

Bookmarked from Nick Dobos @NickADobos

Super cool generative Ui ai demo from vercel.

Some thoughts on chat as an interface & dynamic UI:

-chat makes sense as standalone app, like chatGPT. Or as a chatGPT wrapper with extra bells and whistles

-but for existing apps, the strategy everyone seems to be going for is “add a chat interface” inside your app.

But scrolling timelines of chat make no sense in 90% of cases

Instead a better option for this same goal is something like a cmd+k cursor. sh style, or superhuman-sque pull to refresh style to issue commands. No long history chats, instead: single commands translated & issued by a GPT wizard, that can trigger into any function in your app

Imagine:
“How can I edit this video to add sparkles?”
“You can click this… then… then…”
Vs
“How can I edit this video to add sparkles?”
“Here’s your video, I applied x y z buttons”

Generative chat Ui like this demo below is gonna be huge, but it will be much much better outside of pure chat back and forth scrollable timelines. Better to be inline another full fledged app/website