Where goes what? is a frequent challenge in graphic design practice. It involves embodied spatial knowledge, a sense for balance, and the ambition for a meaningful arrangement. I am exploring these aspects using computer-based methods, including machine learning techniques.
This simple example clearly shows that layout is about relations. Shouldn’t our design tools take this into account? Think of a layout tool like this:
Graphic designers move around the elements in their design for a sensible composition. This is done in many cycles of re-arrangement and evaluation. At the end, often some kind of balance is achieved. This insistent practice is hidden from the public eye, it is a tacit skill every designer works with.
Since long, artists and designers are preoccupied with the expressiveness of compositions. In Point and Line to Plane (Kandinsky 1947 [1926]) writes: “The ‘above’ gives the impression of a great looseness, a feeling of lightness, of emancipation and, finally, of freedom. […] The effect of ‘below’ is completely contrary: condensation, heaviness, constraint.” He even provides an algorithm – here is my computational interpretation:
Layouts are taken here literally as rhythms. Modular grid layouts can be filled analogous to a sequencer. Placing a headline, text, image, and whitespace also produces a drum sound. That way the layout can be appreciated with eyes and ears. Try it out and see code at https:editor.p5js.org/jraff/sketches/3sVKVGSuU
This is also a playful way to obtain data to train an artificial neural networks (it is a pattern in data finder) that generates new, preferred layouts:
Kandinsky, W. (1947). Point and line to plane. Contribution to the analysis of the pictorial elements. New York: Solomon R. Guggenheim Foundation.
Kepes, G. (1969). The Language of Vision: Painting, Photography, Advertising-Design. Chicago: Paul Theobald.
Raff, J.-H. (2024). Machine Learning for Basic Visual Research in Graphic Design. Proceedings of the 8th International Visual Methods Conference (IVMC8), Rome. AIJR Proceedings Series. https://books.aijr.org/index.php/press/catalog/book/168/chapter/3086