Lighting-app: Convert low-fidelity sketches into interactive and responsive web apps

Hi everyone! :wave:

I’ve been working on Lighting App, an experimental project for the hackathon that uses Llama Vision to create websites from sketches,

Links

Current Progress

This app is still a work in progress as I’m trying to fine-tune the prompt for better results.

Here’s the current prompt I’m using: Prompt File

And here’s how I’m implementing it in the code: Prompt Implementation

Feedback Request

If anyone has a better approach or structure to use with this model, I’d really appreciate your input.

One idea I’ve been considering is:

  • Feeding the response into Llama 70B to make the generated code even more complete.

Do you think that’s an optimal approach? Or is there a better way to achieve this?

7 Likes

@malawad

This is really, really cool. !!!

For anyone else using it, please be aware that you will have to pause a bit between submissions because the rate limit per minute on the free tier is not very large for the vision models.

1 Like

Thank you for trying it out @coby.adams. I think I’ll add a 60s timer to the generate button to account for the rate limit.

2 Likes

Absolutely genius! :sunglasses:

2 Likes

This is cool. You beat me to the name tho haha. I am building a AI gen app, with the same name :sweat_smile: for the hackathon. @vasanth.mohan Guess that won’t be a problem?

3 Likes

Thank you so much! I just got another idea, and hopefully, I can implement it before the hackathon ends because it has me super excited, haha. If you liked this one, you’ll definitely love that one too!

2 Likes

Hahaha, thank you! I’m so terrible at naming things, I just add “-app” to all my projects. Best of luck with your project! I’m looking forward to seeing Lighting App and what you’ll build.

3 Likes

Lol no worries on the name - better to use a name that works than something too random

1 Like

@malawad Hats off to you for tackling the futuristic combo of sketch-to-website generation, truly a designer’s dream! :art::arrow_right::computer:

1 Like

Thank you so much @prafull.thokal. Actually in my last hackathon my teammate was a designer who felt really intimidated by coding. I kept encouraging him to give it a try. So this project was inspired from that experience haha. Now, I just want to get better at prompting so I can make the model understand interactions between diffident elements and maybe even create simple animations.