#multimodal llm

[jstnlowe]

Working with Midjourney & GPT4

One of a series of little experimental projects that I have been doing with Midjourney v5 and GPT4 (via OpenAI ChatGPT Plus). Sometimes it's tough to find the right words to convey an idea.So why not leverage an LLM that knows all the words and ask it to help us talk to the other LLM? It's pretty rad.

GPT4 Prompt: Give me a 10-15 word sentence summarizing the compositions and subjects of La Città Nuova by Antonio Sant'Elia, followed by 10 to 15 short phrases, comma-separated, describing the style and aesthetics, then a list of the methods and materials used by the artist in creating the works. GTP4 Response: […] depicts innovative urban structures featuring interconnected, multi-level living spaces. Futuristic, dynamic, geometric, bold lines, vertical, industrial aesthetic, monumental, integrated infrastructure, elevated transportation, modern metropolis. Ink on paper, architectural drawings, perspective sketching. Midjourney Prompt: innovative urban structures featuring interconnected, multi-level living spaces. Futuristic, dynamic, geometric, bold lines, vertical, industrial aesthetic, monumental, integrated infrastructure, elevated transportation, modern metropolis. Sepia, ink on paper, architectural drawing, perspective sketch, white background --v 5

Midjourney gave these as the responses:

For comparison, here are two of Sant'Elia's drawings from La Città Nuova:

[jstnlowe]

Working with Midjourney & GPT4 - Part II

Again, using GPT4 to generate concise prompts for specific concepts.

GPT4 Prompt: In the form of a 100-word prompt suitable for use with an AI image generator: describe the exterior architecture and features of an ideal small, modern cabin in the woods. GPT4 Response: Design a cozy, modern cabin nestled in a lush forest. Incorporate a minimalist exterior with clean lines, floor-to-ceiling windows, and natural materials like wood and stone. Include a sloping green roof, an outdoor deck, and subtle exterior lighting. Situate the cabin on a serene clearing surrounded by tall trees, with a meandering footpath leading to its entrance.

The above was used as the Midjourney Prompt for v5. Here are a few of the results: