{"id":643,"date":"2019-10-25T17:18:21","date_gmt":"2019-10-25T17:18:21","guid":{"rendered":"http:\/\/digital.eca.ed.ac.uk\/sonicstructures\/?p=643"},"modified":"2019-10-30T11:31:25","modified_gmt":"2019-10-30T11:31:25","slug":"lecture-07-interface","status":"publish","type":"post","link":"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/2019\/10\/lecture-07-interface\/","title":{"rendered":"Lecture 07: Interface and devices of control"},"content":{"rendered":"\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"http:\/\/cineplex.media.baselineresearch.com\/images\/490999\/490999_full.jpg\" alt=\"\"\/><\/figure>\n\n\n\n<p>Some of these notes originally produced by Owen Green:<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Preamble<\/h2>\n\n\n\n<p>What do we mean by &#8216;interface&#8217;?<\/p>\n\n\n\n<p>It&#8217;s easy to collapse the idea to just being about knobs and dials but this approach misses a lot and is prone to produce slightly disappointing results. Whilst the bulk of this session is going to revolve around practical demonstrations of getting data from the outside world in to MAX, it is important that we first take the time to think properly about what it is we are trying to achieve with our interfaces \/ interfacing.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Function &amp; Affordance<\/h3>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"alignright\"><a href=\"http:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech1.png\"><img decoding=\"async\" loading=\"lazy\" width=\"468\" height=\"157\" src=\"http:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech1.png\" alt=\"tech1\" class=\"wp-image-779\" srcset=\"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech1.png 468w, https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech1-300x101.png 300w, https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech1-100x34.png 100w, https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech1-150x50.png 150w, https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech1-200x67.png 200w, https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech1-450x151.png 450w\" sizes=\"(max-width: 468px) 100vw, 468px\" \/><\/a><\/figure><\/div>\n\n\n\n<p>The orthodox conception of technology assumes a simple, static model where technologies represent functions in an uncomplicated way. By this account the &#8216;interface&#8217; is just something that mediates our actions and be judged more or less successful in how it enables one to perform some function. This model only really works for relatively simple cases: by and large the notion of what function a technology performs simply isn&#8217;t so clear cut (especially for things like musical instruments).<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"alignleft\"><a href=\"http:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech2.png\"><img decoding=\"async\" loading=\"lazy\" width=\"268\" height=\"195\" src=\"http:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech2.png\" alt=\"tech2\" class=\"wp-image-780\" srcset=\"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech2.png 268w, https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech2-100x73.png 100w, https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech2-150x109.png 150w, https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/files\/2015\/11\/tech2-200x146.png 200w\" sizes=\"(max-width: 268px) 100vw, 268px\" \/><\/a><\/figure><\/div>\n\n\n\n<p>One way of approaching the richness of the topic beyond simply knobs and dials is through the concept of <em>affordances<\/em>, which come from James Gibson&#8217;s work developing an ecological account of perception. Affordances give us a more sophisticated idea of what something is<em> supposed to do<\/em> by highlighting that what something can be used for is actually a function of the <em>relationship<\/em> between a organism, an object and wider environmental factors (including the autobiography of the organism). For instance, a chair affords sitting to us humans because its shape and our shape make this an evident possibility but <em>also<\/em> because we have a personal and cultural history of chairs being things to sit on. To a woodworm, the affordances are wholly different.<\/p>\n\n\n\n<p>By this account, interface takes on a much more dynamic role as something that arises <em>between<\/em> a person and a thing: what this thing seems able to do is shaped in part by its actual physical characteristics but also by our curiosity, desires and sense of possibility. This recalls a concept of <em>intra-action<\/em> developed by the theorist-physicist Karen Barad:<\/p>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" width=\"605\" height=\"340\" src=\"https:\/\/www.youtube.com\/embed\/v0SnstJoEec?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<blockquote class=\"wp-block-quote\"><p>Applied to our working context then, our point is that the way we design interfaces for our sound making gizmos, especially when dealing with software, is a more sensitive set of problems than just finding something&nbsp; that works. The decisions we make will promote some ways of interacting and occlude others and precisely how this happens is a function of us as cultural beings and individuals, but also the the kind of work we&#8217;re trying to do. (e.g. making something to support making a collaborative soundtrack for a film&#8230;)<\/p><\/blockquote>\n\n\n\n<h3 class=\"wp-block-heading\">Gesture<\/h3>\n\n\n\n<p>A major concern when crafting interfaces for soundful software revolves around the relationship between the characteristics of our physical movement and the resulting sound.<\/p>\n\n\n\n<p>How these relationships work out have a significant bearing on how playable we find our interface, as well as how intuitive and how flexible.<\/p>\n\n\n\n<p>Things to consider in particular are whether the interface affords being <em>timely <\/em>for the context we&#8217;re working in<\/p>\n\n\n\n<ul><li>Can we get to where we need to be, sonically, in the time available?<\/li><li>Can we start <em>and stop<\/em> with appropriate speediness?<\/li><\/ul>\n\n\n\n<p>and the extent to which a sound seems to be <em>appropriate <\/em>to the physical movements we&#8217;re making<\/p>\n\n\n\n<ul><li>Do differences in physicality produce desirable differences in sound?<\/li><li>Does the system respond to our excitement?<\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Mapping<\/h2>\n\n\n\n<p>The standard vocabulary for approaching the <em>engineering <\/em>of crafting these relationships between physical and sonic gesture centres around the concept of <em>mapping<\/em>.<\/p>\n\n\n\n<p>Conceptually, we regard the problem as concerning how to relate a set of <em>controls<\/em> (data from somewhere) to a set of <em>parameters<\/em> of our synth \/ system. I&#8217;m sure this is familiar to many of you who have used, say, Ableton Live.<\/p>\n\n\n\n<p>A mapping describes the way that an input relates to an output. We&#8217;ve already seen some of this in previous weeks where we&#8217;ve scaled inputs in to some range, or seen that we can interpolate between presets with pattrstorage. Viewed in this way, we have a powerful toolbox of techniques inherited from control system engineering.<\/p>\n\n\n\n<p>We can conceptualise different kinds of mappings between controls and parameters:<\/p>\n\n\n\n<ul><li><strong>one to one<\/strong>: a single control drives a single parameter<\/li><li><strong>one to many<\/strong>: a control drives many parameters<\/li><li><strong>many to one<\/strong>: different controls affect a single parameter<\/li><li><strong>many to many<\/strong>: some arbitrarily complex relationship between controls and parameters.<\/li><\/ul>\n\n\n\n<p>This separation of concerns certainly makes engineering sense in terms of keeping the problems tractable, and maximising the potential for re-using components of software, but does miss out on the textural richness of real physical systems, where what we regard as &#8216;controls&#8217; may themselves be interestingly cross-coupled rather than totally independent (just for instance).<\/p>\n\n\n\n<p>This leads to a important idea to bear in mind: actual physical actions may be radically non-linear, surprising, noisy, extensible in ad hoc ways, whereas systems designed according to a engineering orthodoxy may be sterile, unexciting, closed. A pressing question is <em>always <\/em>how to preserve the excitement of the phsyical and the messy (to which there are essentially two pathways: engineering <em>less <\/em>(e.g. not de-noising) or engineering much, much more (e.g. machine learning).<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Your options in designing a computer-sound control system<\/h3>\n\n\n\n<h4 class=\"wp-block-heading\">Option 1 &#8211; controller to sound<\/h4>\n\n\n\n<p>A bespoke piece or project designed specifically for the interface you have to hand:<\/p>\n\n\n\n<ul><li>benefits<\/li><li>challenges<\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Option 2 &#8211; some control is needed but you don&#8217;t know what it will be<\/h4>\n\n\n\n<p>A project that needs control but may have different controllers as the piece and your studio evolves<\/p>\n\n\n\n<ul><li>benefits<\/li><li>challenges<\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\">Option 3 &#8211; controller needs to do multiple things simultaneously<\/h4>\n\n\n\n<ul><li>benefits<\/li><li>challenges<\/li><\/ul>\n\n\n\n<h4 class=\"wp-block-heading\"><strong>Option 4 &#8211; a change in controller will radically change how things are played but not the system \/ sound itself<\/strong><\/h4>\n\n\n\n<ul><li>benefits<\/li><li>challenges<\/li><\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Demos<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Getting things in to Max<\/h3>\n\n\n\n<ul><li>MIDI<\/li><li>Phone<\/li><li>HI (joysticks)<\/li><li>Others? (Camera? Microphones?)<\/li><\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Dealing with Data<\/h3>\n\n\n\n<ul><li>Scaling, smoothing, labelling, routing<\/li><\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Mapping<\/h3>\n\n\n\n<ul><li>Let&#8217;s try and make a example together<\/li><\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Tools of interest<\/h3>\n\n\n\n<p>Iannix &#8211; sequencing &#8211; <a href=\"https:\/\/www.iannix.org\/en\/\" class=\"autohyperlink\">www.iannix.org\/en\/<\/a><br>\nAntescofo &#8211; score following &#8211; <a href=\"http:\/\/forumnet.ircam.fr\/product\/antescofo-en\/\" class=\"autohyperlink\">forumnet.ircam.fr\/product\/antescofo-en\/<\/a><br>\nQlab &#8211; show control &#8211; <a href=\"https:\/\/figure53.com\/qlab\/\" class=\"autohyperlink\">figure53.com\/qlab\/<\/a> (can pay per day for full functionality)<br>\nOsculator &#8211; <a href=\"https:\/\/osculator.net\/download\/\" class=\"autohyperlink\">osculator.net\/download\/<\/a> (it&#8217;s paid, but quite cheap given the hours required to make similar in Max\/PD)&#8230;<\/p>\n\n\n\n<p>&#8212; what else?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Some of these notes originally produced by Owen Green: Preamble What do we mean by &#8216;interface&#8217;? It&#8217;s easy to collapse the idea to just being about knobs and dials but this approach misses a lot and is prone to produce &hellip;<\/p>\n<p class=\"read-more\"> <a class=\"more-link\" href=\"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/2019\/10\/lecture-07-interface\/\"> <span class=\"screen-reader-text\">Lecture 07: Interface and devices of control<\/span> Read More &raquo;<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"acf":[],"_links":{"self":[{"href":"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/wp-json\/wp\/v2\/posts\/643"}],"collection":[{"href":"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/wp-json\/wp\/v2\/comments?post=643"}],"version-history":[{"count":16,"href":"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/wp-json\/wp\/v2\/posts\/643\/revisions"}],"predecessor-version":[{"id":1274,"href":"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/wp-json\/wp\/v2\/posts\/643\/revisions\/1274"}],"wp:attachment":[{"href":"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/wp-json\/wp\/v2\/media?parent=643"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/wp-json\/wp\/v2\/categories?post=643"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/digital.eca.ed.ac.uk\/sonicstructures\/wp-json\/wp\/v2\/tags?post=643"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}