Final Piece for 4D
Ok so this is my final piece for 4D – Moving Sound
It hasn’t turned out quite the way I hoped but it still is effective and shows how time and space can be compressed and peoples movements can be tracked by the sound that they’re hearing while following their own route. It’s interesting to see how different peoples journey has overlapped and their paths cross without them being aware of the other persons movements, and how they take different things from what they hear.
Here it is:
If I could take this further, I would enable you to zoom in and isolate a particular sound clip to the place they are in, for instance when Annabel is talking about Tinside pool being open already, being able to zoom into her timeline that the line represents to the point when she was there exactly. Or the bar that Tim walks past when he decides to go for a quick drink after skating at Prime.
I’d also like to be able to add spots like the picture shown in Visual so that you can play the sounds heard on that persons timeline, and perhaps enable someone to go forward or back on one persons timeline, as well as being able to play it from beginning to end in a linear fashion.
I would also consider using a different programme to animate the timelines or at least the sound that goes with them, maybe AfterEffects or something. Only because I didn’t think flash handled the audio too well, in other editing software the actual sound files were quite loud, so that the background noise really stood out as well, however when importing to Flash it becomes quieter so you can only really hear the voice of the person and hardly hear what’s going on around them.
For instance when Tim is walking past the bar, you should be able to hear a barmen hand over a Corona to a customer, or with the Fish and Chips hear someone order them instead it’s too faint to make out.
Flash
I’ve recorded the sound, peoples description and the background noise around them, I’ve uploaded that to the computer and edited it, now it’s time to visualize the data.
I kept with the idea of mapping their route on google maps and drawing their route out, but I thought having plain lines looked a bit dull, so I’ve changed it, just by adding one or two effects to it so the lines are luminescent, giving it a cool look, and how detailed their route is also effects the size of the line and the effect given.
So for one of the routes it was a small route but quite detailed so it’s thicker than the other lines, and one has a longer route but less detailed, so is thinner etc. (see below)
What I’m now going to do, is import these routes into Flash, and add motion tweens to them so that the line grows with the audio, as well as adding an interface so someone can play all of the clips, or one of them or two or only three or whatever, this makes it a bit more interactive.
I would like to keep with the idea of having spots to show when sound was recorded but unfortunately flash isn’t able to handle it too well, and instead makes it very big and very slow! I will just have to work with what I’ve got.
The audio still plays, and you can still see where peoples paths have interacted, and what’s going on around them which is what I wanted to show, how audio helps us to see what’s going on without having to be in the same space at the same time as the person.
Voicemail 2
I’ve come across a problem with my voicemail, I cannot transfer the voicemails onto the computer in order to manipulate them or find a way to visualize it either, so I might go back to the recording sound on the mobile phone instead but keep the idea of mapping out their roots and showing how their paths interlock etc.
And maybe I could do a flash animation that shows them their travel route as the sound progresses, so that in the quiet periods the line is still going despite nothing being recorded showing how long their route takes, but obviously compressing it so that we’re not watching someone route into town take ten minutes lol!
I also think I might scrap the script idea, only because having a ‘forced’ script isn’t needed it doesn’t add much to the piece and the paths cross because their made to cross rather than it being accidently that these people ended up missing each other or being in the same place just a couple hours apart or whatever.
So what I think I’ll do now, is have someone describe their route and record background noise at the same time, so that their position is known from their description and the knowledge of an area rather than being told exactly where they are.
For instance using the Lighthouse on the Hoe as a pin point, maybe have someone realize it’s open so anyone who knows the area will be able to visualize what they see knowing where they are, and maybe being able to show follow their route more closely without graphics by what is seen or heard.
Visual
Now that I’ve decided how I’m going to proceed with the audio, I’ve been thinking about how to visualise what is being heard.
I want to show how peoples lives overlap, so maybe a grid like representation, and if I go along with the script can show where each person was at a particular time, or see where their times crossed paths or their audio matched.
For instance if someone witnessed an event and they had to report it they could go to the police station at 10, and someone else who had seen it went at four, there’d be a dot perhaps on their grid to show when they went there and what they each saw and heard etc.
So i thought about a grid, a way that show their own network made up of time, space and audio to play out the day but from different points of views taken from different times, I just don’t quite know how it’ll work or what it will look like, so I’ve done a mock up of a grid system.
Each line will represent someone’s audio and the dots will show when their paths or times overlapped. (see image below)
I don’t think this type of visualization will work, as I will need more than a couple of people in order for it to look good, a grid made up of four would look more pathetic. Also each of those lines don’t show anything they’re just lines, and they can’t even properly interlink with one another either, the horiztonal lines cannot be linked to one another and neither can the vertical lines.
The image also doesn’t show anything important doesn’t represent what I’m trying to show in my piece.
The other option which is more likely to be the one I choose, it perhaps have each persons route tracked using google maps, and have a line showing where they were going with dots symbolising when they were at a particular place with the audio that goes along with them.
Perhaps where they were when they made the first voice mail, I also think it’s more likely to show how all of their routes were linked in someone despite being their at different times. (See image below)
I do prefer this style, you can see more clearly where one person has been, and how that links with the others, and the dots will show audio was recorded there, which will make it easier to identify the differences of each persons perspective when being in the same place even if it’s at different times.
Mobile Phones
Hmm I haven’t done any more experiments just yet with my 4D project I’ve just been using the time to do research for my dissertation on Mobile phones, something in them has given me a new idea for my project perhaps.
Most of the books I’ve read to do with the wants and needs of mobile phones have looked at how they help society co-ordinate their lives whether it’s for work, family or friends and that got me thinking about how our mobile phones to bend time or at least play around with it.
Our phones are with us at all times of the day, even when it won’t be socially acceptable to use them say at a dinner table but it’s very rare we’re without them. We use them as time devices instead of a watch we check the time on the phone, or instead of a battery powered alarm clock we use our phone.
But that’s not the only relationship between time and phone, messages for instance they bend time to a degree, I can send a message to my friend knowing she won’t get it until a particular time, but that’s ok because I plan for her to get it then and not before.
So I use my phone to play around with time, I send her a message in my present, for her future, perhaps telling her something that happened to me in the past – but I don’t wait to tell her, I tell her right then and now, so the language I use isn’t past as it would be if I was with her to tell her but present, despite knowing it won’t be present when she gets it.
I was thinking about how this could relate to my 4D piece, and I thought about voice mail, and how the background noise could let the receiver know what is or was going on when that person made the call and where, but not get it until after the event.
So thinking about how the listener is transported through sound ignoring time and space to their location, so tying in what I wanted to do, by using sound to recreate a space in an empty space but just using voice mails to do it…looks like more experiments are needed!
I want to see what you can hear when someone leaves a voicemail, whether it picks up the background noise or not, and how I can transfer a voicemal to the computer.
Recording
I’ve uploaded the recordings from that evening with my friends to my computer, it’s going to be interesting to see how it turned out, and whether it produced the effect that I want or hope for. I’m not expecting too much because I did only use mobile phones to record it, and used three different handset providers so I do think the quality of the recording will change.
I recorded about an hour of the evening with no one knowing so that part of the experiment was successful, and the mobile phones were able to handle that, which does mean if I want to do more experiments later I know mobile phones will work might not be the best solution but they can at least work.
After listening to what was recorded I can see it didn’t work quite as well as I hoped…one mobile phone was really good, the sound quality was decent and it managed to pick up a lot with little static (as this can be a problem with other mobile phone recorders) however it was a little bit too good.
Not only did it record what was going on nearest to the phone well, but also what was going on on the other side of the room, so the voices weren’t faint or distant, so that didn’t work quite so well to isolate the sound to each ear depending on where in the room it was taking place.
I was able to do this in editing, because I knew what should be where in that room, so for instance I knew that Tim was sat on the sofa by the double doors of the living room, which is at the back of the room, so any sound from him would be to the left of someone if they stood in the middle of the room looking at the left hand wall.
As for the other two mobile phones, their recordings weren’t great, they were fuzzy and you didn’t quite get what was going on around them, I don’t know whether that’s mainly to do with the device themselves, or because they were recording conversations rather than just sounds or a description.
the I tried to send the audio to the left ear headphone or the right, I was able to use my knowledge of the room and the evening to play with the sound. And although when I played the piece after editing it, I was able to visualize room, what was going on, and where everyone was in relation to me listening as if I was in the middle of the room, it’s not as successful as I would have hoped.
I’m not sure if it only worked because I’d been there, I knew the layout of the room already, I knew where the furniture is or was on that evening, what the people were like, and knew what was going on as I was part of the evening…for my final piece though I want anyone to be able to see what they hear without prior knowledge of the people or the room.
I do know though that more than conversation needs to be recorded, description is vital so that people get a sense of the space they’re inhabiting with the sound and the people in it, and then I’ll need to think of a way to digitally represent that.
Sound
I haven’t had the chance to organise an appropriate time to record, ideally I want it to be in a big enough room that the mobile phones aren’t so close to each other that they end up picking up exactly the same things at the same level, and also when I have more than a couple of people, so that I can add more conversation etc. as for my final piece I want to do something that involves four or five people compared to one or two, to be more affective.
So it has been nearly a month since my last post but tonight I’m having a group of friends round to play games, drink and just chat, it’ll be interesting to see how much of their conversation I can pick up and the different levels of sounds.
Experiments
So I’ve sent in my proposal, got to think how to carry on, and how exactly it’s going to sound, now’s the time for me to do some experiments, I think the main area is trying to get the recording done how it sounds, what manipulation I can do with it just to see if it is possible to do what I want with the sound.
What I’m planning on doing is recording an evening I spend with my friends, using mobile phones from each side of the room get snippets of the conversation to see if it gives an accurate reading of what’s going on, if I can isolate the sound and if I can play around with it so build what’s going on in the room but just by using sound.
They don’t want to be recorded so I’m going to keep quiet about it, and see what happens. I expect the sound to be a bit distorted as mobile microphones aren’t the best quality as I do have to hide the phones from them so they don’t know what’s going on.
Also they won’t be able to describe what’s going on, as they don’t know they’ll need to, however it’ll still be interesting to see what happens and how it goes.
What I’m really hoping from this experiment is that recording an event which is only heard and with no other visual aids a picture of what’s going on can be demonstrated, like for instance if to your right someone puts a cup down and you hear it, then perhaps the hearer could establish that perhaps there’s a table in that general direction.
Or if they hear noises behind them but are faint then they could believe that there’s a door there, and be able to start to visualise the room they’re listening to around where they themselves are stood.
So hope it all goes fine!
4D Proposal
Moving Sound
Project Summary
For my 4D project I wish to investigate the significance our hearing has in relation to everything that’s happening around us, how people use what they hear to respond or react to events that are taken place. I would also like to look into how a recording can trigger a memory, a feeling or a particular thought.
The project will involve recording either an event or someone experiencing something which will then be played back at a later date. The person listening will then experience what the author went through, what they witnessed and heard.
I will do this by getting the listener to follow the same route recorded outside and visual see the space that the author occupied while recording. Alternatively the listener will follow the route but in an empty room, which they’ll be guided through the empty space by what they listen to, and will have to visualise what’s going on mentally.
Development
The project is mainly inspired by the work of Janet Cardiff, her piece “The Missing Voice” which is based in London, follows her as she goes through small allies from White Chapel library to Liverpool Street Station.
She uses the audio to inform the listener of the ideas that go through her mind at being in a new city, alone and a woman.
“I was trying to relate to the listener the stream-of-consciousness scenarios that I constantly invent in my mind when I see someone pass or walk down a dark alley.”
I would like the participant to become aware of the space they’re occupying, to think about who or what is around them, what they smell, hear, see, touch and what is running through the mind of the author on what they’re experiencing.
There a number of ways I could go about developing my project but before I get to that stage I need to decide on how I wish to present the project at the end of the year, as this would then effect what I record and when.
My first idea was to playback an event that happened in a room for the listener to interact with, they hear everything that’s going on in the room, but will have to move to hear different parts more clearly.
My first idea was to take a recording of an event unfolding for instance a crime scene. The listener who is stood in the middle of the room hears what’s going on around them. People walking in, talking, putting cups down on tables etc.
They would then have to move around the room to hear more clearly what’s going on in the right corner, or towards the end of the room etc. So depending on where in the room they decide they hear different parts of the event.
Although this is a good starting point, I think I should expand it more so that the audio isn’t restricted to just four walls, that the recording is of something that happened outside.
This is will also be played back in an empty room, however the listener is hearing a lot more that’s going on, so although they physically are not in the space, they can feel as if they are through hearing.
I could develop it so that the listener are blindfolded, so that they have to concentrate on what they’re listening to, and see mentally what the author saw, navigating around the room, according to what is being said on the recording.
Maybe to develop the project further I could have multiple recordings, and have more people listening to the same event just from different perspectives, so although walking around the same physical space, everyone’s experience will be different.
It’ll also be interesting to see how much people concentrate on listening, whether people bump into each other or not. I could then film everyone listening, and map their movements in a visual way in a 3d model of the room, to display as the final piece.
If I were to follow any of the above ideas, I’d need to decide what to record, the equipment I’ll need and how I’d visually display what’s taking place without using the conventional method of film.
This would link in with the idea of space and how it’s possible to recreate a space using nothing but audio, time how everyone will be listening to an event taking place and recreating it at the same time, but still not truly connected time wise with everyone around them.
It would also represent that despite witnessing or hearing the same event, everyone’s take on what happened differs depending on where they were in relation to what was going on, their own previous experiences and their knowledge of the event.
Plan of Work
To find the ideal final outcome, I first need to investigate the different ways I could present this idea, as mentioned above. By looking at the work and installations of Janet Cardiff and other artist using binaural recordings or sound to represent an event I’m hoping to get some inspiration as to how to proceed.
I’ll also be using the lectures and the tutorials with Mike Philips as references and ideas, on how to present the final project to achieve the outcome I wish. I’d also use the tutorials as an opportunity to negotiate with Mike on the technology or software I could use, as mentioned before I’d probably use After Effects to represent any visual effects I decide to do, so will expand on the skills I already have in that programme over the next few weeks.
The next step would have to choose what to record, whether I go around the city and find something to base the recording on and then get volunteers to re-enact the scene from everyone involved. I could skip the first part and make a scene up and allow the actors to improvise on the whole event.
The development of the audio piece should be completed by early 2010, therefore I could get people to volunteer to take part in the next stage of development, the play back, I’m hoping to get this done as soon as possible after the completion of the audio work so that if the play back does not go according to plan I have time to alter it and to test it out again.
Once the play back has gone according to plan, the next stage will be using the data recorded and turning it into a visual display, one which I’ll use to present, on the screen as part of the finished project, as well as visually showing the event taking place, what everyone heard will also be playing so that the audience can get a real feel for what was going on in everyone’s minds.
Output
The outcome of my project will be a piece of work which has the potential to be a visual and a digital representation on how humans use the sense of hearing to interpret what they see around them, and how this has an effect on how they react to situations.
I would also like it to show how everyone can interact with each other without being allowed contact, whether that’s just by feeling someone next to you, or hear part of their conversation or just by a sixth sense of knowing something is there.
References
Initially the only reference I have at the moment is Janet Cardiff, but with more research into the subject I’m hoping to find some more art forms of a similar nature.
However I am hoping to find a few books in the library to do with hearing and memory to get some idea of how they both link with one enough, and see how I could use that information to develop my project on.
Moving Sound
Project Summary
For my 4D project I wish to investigate the significance our hearing has in relation to everything that’s happening around us, how people use what they hear to respond or react to events that are taken place. I would also like to look into how a recording can trigger a memory, a feeling or a particular thought.
The project will involve recording either an event or someone experiencing something which will then be played back at a later date. The person listening will then experience what the author went through, what they witnessed and heard.
I will do this by getting the listener to follow the same route recorded outside and visual see the space that the author occupied while recording. Alternatively the listener will follow the route but in an empty room, which they’ll be guided through the empty space by what they listen to, and will have to visualise what’s going on mentally.
Development
The project is mainly inspired by the work of Janet Cardiff, her piece “The Missing Voice” which is based in London, follows her as she goes through small allies from White Chapel library to Liverpool Street Station.
She uses the audio to inform the listener of the ideas that go through her mind at being in a new city, alone and a woman.
“I was trying to relate to the listener the stream-of-consciousness scenarios that I constantly invent in my mind when I see someone pass or walk down a dark alley.”
I would like the participant to become aware of the space they’re occupying, to think about who or what is around them, what they smell, hear, see, touch and what is running through the mind of the author on what they’re experiencing.
There a number of ways I could go about developing my project but before I get to that stage I need to decide on how I wish to present the project at the end of the year, as this would then effect what I record and when.
My first idea was to playback an event that happened in a room for the listener to interact with, they hear everything that’s going on in the room, but will have to move to hear different parts more clearly.
My first idea was to take a recording of an event unfolding for instance a crime scene. The listener who is stood in the middle of the room hears what’s going on around them. People walking in, talking, putting cups down on tables etc.
They would then have to move around the room to hear more clearly what’s going on in the right corner, or towards the end of the room etc. So depending on where in the room they decide they hear different parts of the event.
Although this is a good starting point, I think I should expand it more so that the audio isn’t restricted to just four walls, that the recording is of something that happened outside.
This is will also be played back in an empty room, however the listener is hearing a lot more that’s going on, so although they physically are not in the space, they can feel as if they are through hearing.
I could develop it so that the listener are blindfolded, so that they have to concentrate on what they’re listening to, and see mentally what the author saw, navigating around the room, according to what is being said on the recording.
Maybe to develop the project further I could have multiple recordings, and have more people listening to the same event just from different perspectives, so although walking around the same physical space, everyone’s experience will be different.
It’ll also be interesting to see how much people concentrate on listening, whether people bump into each other or not. I could then film everyone listening, and map their movements in a visual way in a 3d model of the room, to display as the final piece.
If I were to follow any of the above ideas, I’d need to decide what to record, the equipment I’ll need and how I’d visually display what’s taking place without using the conventional method of film.
This would link in with the idea of space and how it’s possible to recreate a space using nothing but audio, time how everyone will be listening to an event taking place and recreating it at the same time, but still not truly connected time wise with everyone around them.
It would also represent that despite witnessing or hearing the same event, everyone’s take on what happened differs depending on where they were in relation to what was going on, their own previous experiences and their knowledge of the event.
Plan of Work
To find the ideal final outcome, I first need to investigate the different ways I could present this idea, as mentioned above. By looking at the work and installations of Janet Cardiff and other artist using binaural recordings or sound to represent an event I’m hoping to get some inspiration as to how to proceed.
I’ll also be using the lectures and the tutorials with Mike Philips as references and ideas, on how to present the final project to achieve the outcome I wish. I’d also use the tutorials as an opportunity to negotiate with Mike on the technology or software I could use, as mentioned before I’d probably use After Effects to represent any visual effects I decide to do, so will expand on the skills I already have in that programme over the next few weeks.
The next step would have to choose what to record, whether I go around the city and find something to base the recording on and then get volunteers to re-enact the scene from everyone involved. I could skip the first part and make a scene up and allow the actors to improvise on the whole event.
The development of the audio piece should be completed by early 2010, therefore I could get people to volunteer to take part in the next stage of development, the play back, I’m hoping to get this done as soon as possible after the completion of the audio work so that if the play back does not go according to plan I have time to alter it and to test it out again.
Once the play back has gone according to plan, the next stage will be using the data recorded and turning it into a visual display, one which I’ll use to present, on the screen as part of the finished project, as well as visually showing the event taking place, what everyone heard will also be playing so that the audience can get a real feel for what was going on in everyone’s minds.
Output
The outcome of my project will be a piece of work which has the potential to be a visual and a digital representation on how humans use the sense of hearing to interpret what they see around them, and how this has an effect on how they react to situations.
I would also like it to show how everyone can interact with each other without being allowed contact, whether that’s just by feeling someone next to you, or hear part of their conversation or just by a sixth sense of knowing something is there.
References
Initially the only reference I have at the moment is Janet Cardiff, but with more research into the subject I’m hoping to find some more art forms of a similar nature.
However I am hoping to find a few books in the library to do with hearing and memory to get some idea of how they both link with one enough, and see how I could use that information to develop my project on.
Initial Ideas
My proposal for this module is due in, in a week or so so I need to start thinking about what I want to do…like with previous projects I do like the idea of messing around with sound and video to represent something as that’s the field I want to work in when leaving university…so have to think what I could do.
And come up with something which is different – the other day I was watching an episode of Fringe and they did this weird thing with a piece of glass, when someone built some equipment which played the round glass like a record, that gave me an idea, not saying I’m going try and make glass record sound that would be rather ambitious let alone probably impossible but it got the idea of recording an event from an empty room…and then playing it back to recreate what happened.
What I was thinking, is perhaps use sound to create a room in an empty space, by having the listener pay attention to the sounds their listening to from one side to the room to the other, and somehow get them to see the room before them, when in fact there is nothing…or do this on a grand scale by having different people participate at the same time, and not just limit it to left or right or whatever, but mess around with surround sound…so there’s one idea that’s just hanging out there. Will need to think about it and discuss it with Mike.
Other than that, I’m still playing around with what I could do with sound and visual like with Da Ja Vu or something along those lines because I do like the type of thing they’ve done there, or the conversation, I do like the idea of using only sound to play around with time and space etc, another thing I need to think about is how i’ll digitally visualise it.
