Hacker Newsnew | past | comments | ask | show | jobs | submit | MikahDang's commentslogin

I FEEL THE AGI I LOVE YOU ALL. - gpt-2 chatbot


I FEEL THE AGI


Thank


Thank!


We would check this soon. Thank you for your feedback.


I think that is true. And I also think the future would be automated by the algorithm but the human will still be a significant part in deciding the outputs. Humans cannot be replaced 100% unless big corps create something truly AGI.


Thank you for your reply. Could you give us more details on that idea?


It’s how the original image recognition obfuscation techniques worked. You’d update an image by backpropagating from the desired output category.

LLMs are much more complicated structures than imagenets, so I’m sure there are a lot of challenges involved.

Also I imagine the input (output?) might be complete ghibberish.


Thank you.


Thank you for trying. Yes, this is AI-generated. We fine-tuned a special LLM with a huge dataset of prompts with a Monte Carlo algorithm to explore the solution space. We have evaluated every single prompt in our datasets before fine-tuning them with LLM metrics.


So, you've created an LLM specifically for generating prompts for other LLMs? A meta-LLM?

That tickles my engineering receptors in a pleasing way (), but my financial side has questions. The most pressing: if this is successful and useful, why wouldn't the LLMs that you're targeting just replicate your creation and transparently put it between users and their own LLM?

In other words, what is your moat here?


This is a great question. Actually, I have two opinions about this: - It is not economically useful for foundational model providers to build this, or at least integrate it with their products, because it will cost them double. They would prefer RLHF and something intrinsic to their models. - Our dataset is proprietary. We have to collect and write a huge number of prompts to fine-tune it well. And our model is not 100% LLM, we use a version of the evolutionary algorithm to control the quality.

I would say we have a tiny moat of data and algorithm. But at the end of the day, it is about delivering something people find useful. If we could be replaced, let it be. But it works for now.


> The most pressing: if this is successful and useful, why wouldn't the LLMs that you're targeting just replicate your creation and transparently put it between users and their own LLM?

> In other words, what is your moat here?

He is using other people platforms to create a business, layers on top of LLMs won't have a moat, not even training the LLM is guaranteeing a moat. Why on earth everybody asks this on Show HN? The world doesn't need more big techs with moats, we need a healthy ecosystem where multiple players can work together without killing each other and become the only option. No moat, please.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: