Hacker Newsnew | past | comments | ask | show | jobs | submit | account73466's commentslogin

This time it is different.^{tm}

More seriously, we are almost about to

i) Generate a good book using a short intro.

ii) Generate a meaningful video using a few photos and a basic text scenario.

Which makes us closer to generate movies on demand (say in 2025) and then good luck to people claiming that the current progress in AI is a bubble.


We’re no where near a “good book” (we can’t even do a good 3 paragraphs reliably), nor a “meaningful video.”

You’re confusing a 1000 monkeys (transformers) with 1 human intelligence (AGI). That giant leap hasn’t been met.


Have you seen the tables in Appendix E (starts p. 16) of the Transformer-XL paper? I think they're pretty good.

https://arxiv.org/pdf/1901.02860.pdf


Quote from that paper:

> The Battle of Austerlitz was the decisive French victory against Napoleon

It didn't even catch that Napoleon was the leader of the French as described in the source snippet. And this was when it just generated text of similar size as the input. Based on just that paper I highly doubt that this method will generalize to creating entire books.


"he was still in conflict with Emperor Napoleon, the French Republic’s king"


My point was that the text lacked coherence, that quote only makes it worse. If it can't even keep coherence for a single page how would it manage for a hundred?


by improving metrics over time

see, e.g., https://gluebenchmark.com/leaderboard/


Oh fuck, I am banned here from getting points. Time to avoid selling my own profile to whoever sniff on HN users.


You're not banned here.


Glad to find they used something from my research. Don't want to disclose more, was flagged too much.


I guess you are not from the field.

Edit: I was right, he is an engineer and not a researcher who is active in the field.


Please don't make personal dismissals. That's not in the spirit of this site, and we already had to ask you about this: https://news.ycombinator.com/item?id=21615955.

Instead, if you know more, share some of what you know. Then we all can learn something.

https://news.ycombinator.com/newsguidelines.html


Especially since I do have a background in AI and machine learning.


[flagged]


Care to link the papers that makes you so sure that we will soon be able to generate whole coherent books? As far as we know you could just be an enthusiastic college student who knows nothing.


[flagged]


"You're confusing X with Y" uses a personal pronoun but I don't think I'd call it a personal attack—it's a common phrase in spoken English. Maybe "That's confusing X with Y" would be a modicum more polite, but only a modicum.

Please stop these low-information, bilious comments now. It's not contributing positively to sniff at others' lack of credentials and tout yourself. Experts are welcome here if they want to share their expertise, but just being dismissive isn't a good thing for any HN user to do, expert or no.


You talk as if you have information to share, why don't you share it?


If you think A and I think B, I am allowed to say B without proving it to you. You can say that my claim is unsupported but by insulting me in a parallel thread you learn nothing. Be open-minded and assume that what you see in open is not everything primarily due to different compute capabilities available to different actors.


[flagged]


Above, AlexCoventry mentioned a paper. If you would like to find more, go to Google Scholar and find all papers which cite that paper. This would be just a part of the whole story since bigger datasets and models are not in open. The progress rate in this field is incredible.


Quote from that paper:

> The Battle of Austerlitz was the decisive French victory against Napoleon

It didn't even catch that Napoleon was the leader of the French. And this was when it just generated text of similar size as the input. Based on just that paper I highly doubt that this method will generalize to creating entire books.


AI winters are caused because people keep thinking the effort required to achieve some improvement is linear instead of exponential.


I mean, even if we were to get nothing else out of the current AI boom, it'd e hard to call it a bubble as much as the 80s crash.


>> None of this is to say that weed can't be beneficial.

There might be a non-trivial impact of weed on climate change if weed consumers produce less kids which according to UNESCO is the best way to reduce your carbon footprint.


Depending on which ideology you follow one could also make the case that this happens in first world nation that already have a problem with lower and lower birthrates.


Of course. Because my definition of rich/poor is w.r.t. people around and not some world's mean/median. Many people in first world nations cannot afford to have as much kids as even 40 years ago.


It also reduces road traffic and all manner of queues.


Yeah, some rich people don't get why poor people want to have kids and pollute this planet (according to them). Fortune's list suggests that the median number of kids is 2-3.


You review seems pretty accurate. Very rarely there is some lucrative incentive to join as an employee.


I feel like it is hard for people to say what they truly love before they have at least $1M in their bank account. If you have FU money, your view on working at a FAANG vs building a startup can change. You will find it easier to know what you truly LOVE.


That assumes that the person doesn't change in the meantime. You might put your dreams on hold to solve the money problem, only to discover that you no longer have the energy or focus to accomplish what you could have in the past. End state: I wish I had done what I loved back then.


>> That assumes that the person doesn't change in the meantime.

In the meantime of what? I didn't suggest any action but merely suggested that sometimes money could clarify whether you do something because you love it or/and because you have to make money.


I'm glad all the great artists, musicians, writers, theorists, scientists, teachers, and inventors throughout history didn't read this post.


A remarkably large number of the most notable of those people came from wealthy families - that’s what allowed them the single-minded focus, instead of worrying about food and healthcare.


And a lot of them suffered in poverty to pursue what they loved. Is there survivorship bias there? Sure. You don't become great without taking some chances though.


> I'm glad all the great artists, musicians, writers, theorists, scientists, teachers, and inventors throughout history didn't read this post.

Except they did. Countless people have done the calculus and decided that their creativity wasn't going to put food on the table.


If we want to equate them then we should aspire to write code that is meaningless while we are alive, while living our entire lives poorly or being completely ostracized in society?

I'm not sure the startup angle jives with the artist's.


Most of the code I've written in my life has been meaningless, but yes I get paid well. The ostracisation happened to a lot of devs during high school through the invention of the wedgee.


I am a scientist and thousands of scientists and engineers use my work.

Most great artists, musicians, writers, theorists, scientists, teachers, and inventors would not need to struggle as much if they would have some money to cover their basic needs. They would just avoid bullshit gigs and do they stuff with a greater focus. And if having $1M in their bank account would stop them doing what they love, then it is quite possible that they didn't love it in the first place.


Artistic pieces or songs are generally a representation of an event, a struggle, or a state of mind - if you lead a cushy life then no, you're not going to have the same output than if you were living on the breadline. There's a reason that history is dotted with songs and pieces of art that were written during times of struggle.


>> you're not going to have the same output than if you were living on the breadline

That is what poor people are told to justify their struggle.


$1M is not FU money for someone in a major metropolitan US city with kids.


If someone doesn't hit FU at $1M in the bank, you probably never will, which is ok.

$1M is about 20 years of coast on a modest bay area mortgage + family healthcare.


And the remaining 30 years of life you have low ability to earn income, but face higher taxes and healthcare spend.

To me, FU money is passive investments which yield a couple hundred thousand a year from businesses that can keep up with inflation.


Perhaps that gets at my intended point, which is that different people have different comfort and stability thresholds.

If someone doesn't feel comfortable leaving a job to bet on a startup project with 20 years of mortgage payments in the bank, it is unlikely they ever will.


1 million is 40.000 dollars per year indefinitely, by the 4% rule, with a small risk of ruin that you'll most likely see coming years in advance.

It should be possible to live in the Bay Area on that, given that the place still has cashiers, cleaning personnel and maintenance workers. It won't be a middle-class lifestyle, but you'd have to make _some_ sacrifices in order to indefinitely work at whatever you want in the most expensive place in the world.


Never having visited myself, this is what I don't get about the bay area. How is it still a functioning city? How far out do you have to live to be able to afford rent on a non-tech bro salary?


You posed some simple-sounding questions, but the Bay Area is a very complex real estate market to understand.

So I'll just give you some simple answers.

If you don't already own a house, it's not a functioning area for families, or those wanting to own a house, aka "priced out forever."

Commuting farther is an option in other parts of the USA, but not the Bay Area, since it's constrained by hills and the Bay.

The non-owners living here need a gaffe of some kind:

* shared accommodation

* fly into a city airport with a private plane

* know a Prop 13 owner (ultra-low property tax) who wants to rent to a friend

* find an in-law unit coming onto the rental market

* navigate the Sunset area flop houses

* connections to ethnic communities with below-market asks

* get employer to chip in

* homestead a sketchy area of Oakland

* be a multi-unit superintendent (those used to offer a free apt. on-site, but recently I heard of almost market rent being charged)


but why would anyone do this not making a stupid salary? i don't get the appeal why anyone would put up with that just to have the privilege of serving coffee to techies in a formerly cool city. (not to imply that techies aren't cool)


> It should be possible to live in the Bay Area on that, given that the place still has cashiers, cleaning personnel and maintenance workers.

There’s no reason pay for cashiers, cleaning personnel, and maintenance workers can’t rise, or to meet the demand of labor with a little bit of automation also. Making $40k per year as a cashier means $80k as a couple or roommates.


Bay area on $50k/yr? Is that some kind of joke or did you mean to type 2 years?


Why not? If you have a partner, you would be able to cover half a mortgage, and if not you can get a roommate. I know tons of people who aren't in tech that make ~50K. It makes sense because 50K is pretty close to the median per capita income in SF [1] and a starting teachers salary [2].

[1] https://smartasset.com/retirement/average-salary-in-san-fran... [2] https://www.salary.com/research/salary/benchmark/public-scho...


I mean, I don't live in SF so maybe I'm off base. But my impression is that even with a roommate you're looking at $1500-2000/mo. That's oppressive on $50k/yr.


How so? 3k a month is a lot of fun money.


Even assuming 0 tax we're talking more likw 2200-2600 and there are gonna be some taxes, especially in CA.

Assuming this is investment income of course, and not just spending down the principal, which obviously wouldn't work.

So probably under 2k, and it's not fun money, it's everything but housing starting with food and transportation.

Doable? I guess. Fun? Eye of the beholder, I'd say. And that's assuming kids don't enter the picture, say goodbye to every part of this plan if they do.


I wholeheartedly agree 50K is a miserable salary in the Bay, but the original premise was $1M in the bank:

>I feel like it is hard for people to say what they truly love before they have at least $1M in their bank account. If you have FU money, your view on working at a FAANG vs building a startup can change. You will find it easier to know what you truly LOVE

The question wasn't if you can retire, or live of the investment income, but one of perceived finical security. If someone is too afraid to try working at a startup with $1M cash in the bank, it is unlikely they ever will.

Even if someone has kids and family, $1M provides a huge buffer to find a new job if the startup doesn't work out. Maybe 20 years is a stretch, but I am utterly baffled that other posters think this would only cover 2 years of spending...


> you would be able to cover half a mortgage

Not in the Bay Area.

Looking at an excel for a million-dollar+ home is truly frightening. So many zeroes!


A million dollar home mortgage is about 5k a month. Half is 2.5k/mo, or 30k a year.


If you can live on 4% interest, you can live off of it indefinitely.


For sure. Not in SF though, or so I thought anyway


True, 1M in savings gives you ~40K per year to live off. This wouldn't be sufficient in SF, but given that you're basically retiring at that point, you might as well buy a home somewhere else and then you'd be able to live comfortable off of that.


One has to assume they considered moving out of SF and decided not to.


Or a lifetime of opulent living somewhere sane with low out of pocket health care costs.


$1M is nowhere near FU money, that's a joke to accumulate/spend here in the bay area.

I'd consider $5M closer to FU money.


Yes, that is why I say "at least $1M".


I'd say it's less about the number in the bank account and more about the perceived safety you feel. Similar to the lower two layers of Maslow's Hierarchy of Needs. If you don't think that the worst outcome of pursuing something you truly love is manageable, you're less likely to put yourself up to that risk.

In US this might correlate more strongly to the numbers of zeros in the bank account or the salary difference to similar workers at FAANG. But feeling of safety is subjective and depend a lot on the environment you're in so I don't think that's universally the case.


> I feel like it is hard for people to say what they truly love before they have at least $1M in their bank account.

[edited to protect your feelings]

Are you saying that simple introspection is hard? I completely disagree, because separating extrinsic motivation (I do this for money) from intrinsic motivation (I do this for fun) really isn't that hard.


Instead of being rude, you could try to formulate your point without attacking a straw man.


What you're saying basically amounts to "people are blinded to what they love by their need for financial security". This may be true on some level, but anyone can see through it with a modicum of introspection. Or am I giving the average person too much credit?


I'm not the original commenter, but I think you are vastly oversimplifying the situation. Most jobs are not black and white in one category or the other. There are people who will never be completely happy with any job, and there are local maxima, where one might not reasonably expect a better fit to exist.

>Or am I giving the average person too much credit?

Another consideration is that this is an irrelevant question for your average person, or even 99.9% of the population.


On HN people often do not reply on replies to their comments and it does not mean that they do agree.

It seems like a rather nice thing which helps to avoid many ego-battles.


Not to start an argument, but that could also be because HN doesn't automatically notify you of replies. I'm subscribed to the email notifier, but that was created by a third party and I doubt if a majority of the users know about it.


It contributes as well.


I can imagine this to be true but do you have a source for that information?



Thanks for the links! I am aware of the Buffet's bets but I did have a feeling that some VCs can be quite profitable especially the ones which invest in future government contractors and/or future surveillance facilitators.


The VCs are always profitable - for themselves. They get 20% returns no matter what. Their investors on the hand....


I am wondering how far the essay would go if it were not from PG.


This is basically my biggest critique of PG and various other YC leaders. Many of the conclusions, while likely be probably being more "right" than "wrong" in virtue, are derived from intuition and observations, not evidence based. It's even more ironic, given how much emphasis the firm places on evidence based thinking of its portfolio founders versus anecdotally thinking.

Great example:

"One quality that’s a really bad indication is a CEO with a strong foreign accent"[0]

The danger is that I think pg has been "right" about so many things that every time he pontificates about something it's treated as dogma. So when he's "wrong", it'll be ignored. Impressionable people (which likely fits the characteristic of many young tech entrepreneurs) will therefore be lead astray.

[0] - https://www.forbes.com/sites/knowledgewharton/2013/12/19/292...


Probably not very. I get the distinct feeling that the last few essays were very light on content/interesting insights, and did well on name value alone.

Would be interesting to actually test that to be honest. Get Paul Graham to set up another site under a fake identity, post the next say, three essays there, then submit 'em to HN under the same identity and see the stats.


In some cases it’s because the territory is mostly mapped by his previous work. “Novelty and Heresy” was a belated sequel to “What You Can’t Say”, for instance.

OTOH, seeing pg write essays again pleases me in much the same way that one might be pleased if their favorite long-defunct rock band started recording a new album.


Is this even an essay, or am I missing something? The content behind the link is a few sentences at most. Hardly an essay.


Haha, I was wondering the same. Probably not that far. But at the same time, it is important who says what, so you can't just ignore that.


To start with, it would be called a tweet and not an essay.


When your university is pretty small, it looks more like a faculty and it is somewhat more common for the latter to be professor-led.


Can confirm. When I mentioned to my professor at a small university that the registrar's office made a mistake on my record, he just said let's talk a walk and we walked to the registrar's office. They were all polite to him (and he was to them). The issue that the registrar's office had told me could not be fixed right away because blah blah blah got fixed right away.


This worked for me as a student at UT Austin (population in the low 40ks) in 90s/00s: be polite, ask for a change. Most administrators don’t care what your story is (so I never bothered to explain mine), but they do understand the system isn’t perfect. EDIT: and they really want written documentation.


I guess that it is phrased that way in order to signal other non-government organizations that they should have a look and probably ban it as well.


The most powerful agent is the one which manages to confiscate our only real asset - our time.

Trump is pretty good at it with all the controversies he is generating.

AI-assisted systems will be targeted at maximizing this interaction metric. You are slowly cooked by your favorite entertainer of the day to be then fed with an opinion which you take as your own. It is not novel at all.


This. Fact-checking is more time consuming than making things up. So they can drown out the fact checkers easily. And the facts are often uncomfortably murky. Whereas the lies build loyalty and belonging, an ideal basis for a movement.


> Fact-checking is more time consuming than making things up.

AKA the "bullshit asymmetry principle"

https://en.wikipedia.org/wiki/Bullshit#Bullshit_asymmetry_pr...

"Both sidesism" is a closely related problem.

"We interviewed Elena, a geophysicist, about the different ways scientists collect data about the planet we live on and the cosmos it's situated in. On the other side, Bob from the internet offers his theory about the earth being flat".


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: