by john threat on June 20, 2014
Notes on the generator: It’s working really well the trope engine , the light NLP and the beat matching. Here are to examples here done recently I think rock:
Kenny Loggins: FootLoose
Madness: Our House
However – The Two Stage Analysis Engine is slow. The engine needs some performance enhancements that hopefully I can get to one day soon. The interface also is an amazing kludge. I’ll see if I can do something about that soon. Till then – crank it up and share it around….
Music Videos For The People!
by john threat on May 14, 2014
Monsters is a show I wrote and directed. Monsters is a show about Dick and Dash, two lazy, underemployed, vulgar, disgusting, TV-obsessed, booze drinking, weed smoking, dope-shooting, perpetually broke, never paying rent, never getting laid ne’er do wells who share a filthy, dilapidated apartment in the middle of Brooklyn. They also happen to be monsters who eat people.
Check out the trailer:
Each episode follows Dick and Dash as they attempt to get paid or laid in the most vile and comedic ways possible while often trying to screw each other over. Their hare brained schemes inevitably blow up in their faces, but no matter how hungry, broke or beat up they may be, it’s okay because at the end of the day they still have each other and the huge colony of filthy mice that live in the walls of their apartment.
If you like The Mighty Boosh, South Park, Monty Python, Pee Wee Herman’s Playhouse, The Young Ones, The Odd Couple, Rick and Morty, South Park, Sid and Marty Krofft, Snuff Box, TV Funhouse – you gonna go apeshit for Monsters.
Aww yeah! Get Ready To Crank It Up!
by john threat on May 13, 2014
So over the weekend I coded a Music Video Generator in python and a few bits of HTML5. It uses a bit of sentiment analysis code i whipped up to analyze lyrics and match it to a small internal database of gifs and from the excellent database of GIF’s at GIPHY and assemble a music video for your music or poem!
Here is an example using Bikini Kill’s Rebel Girl:
Here is how it works:
You upload a song here - and the engine gets to work analyzing the Beats Per Minute(BPM), cutting off the silence at the ends and absorbing any meta-data embedded in the file. Then it takes the lyrics and processed it thru rudimentary sentiment analysis – it’s looking for tropes, and concepts based on the proceeding and trailing words to find the best fit. Armed with this – the back-end then polls GIPHY and a small internal database for GIF’s and assembles them in one place.
Next step is to rip apart the GIF’s frame by frame and try to keep their color replacement palettes – which I haven’t figured out how to do for all the different GIF types. It truncates long gifs, and tries to beat match the frame rate to the song. I also instead a header with the FlamePack logo and GIFPHY logo for attribution and respect and fielty. At this point one could plug in the motion tracking and effects stuff I wrote for the watchme engine, but let’s keep it pure for now. During these stages we alert the user on the front end with a cute little running man and running percentage calculated for each phase’s metric.
The final step is to encode it together with the easy step in this using AVCONV which really does the heavy lifting here. We end up with a neat MP4 which we upload automatically to the YouTube channel: musicvideogenerator and present it to the end user. The end user then can watch it or share it to social media via a few buttons and even download it as a nice keepsake. It won’t stay on the local website forever, but you can catch it on YouTube indefinitely.
What’s left to do (with percentage change of getting done):
I thought this would be cool like if you have some spoken word, or even instrumentals, or original music you want to upload to YouTube. I’ve seen some montage videos people cut together, but this generator – let’s the computer do the heavy lifting.
Try it out! If you dig this let me know what ideas you like or hate about it or want to see implemented if I get time to get a V2.0 Of it going!
DIY Automobile Windshield Heads Up Display (HUD) with Kintetic and Raspberry Pi For Motion Tracking.
by john threat on October 10, 2013
So the new Xbox one has a new Kinetics sensor. Those things are awesome. I watched this video explanation here:
So this sparked an idea about mounting one on the front of the car to track the motion of cars in front of the car and feed that information to a raspberry Pi. The raspberry pi then could output the results of it’s tracking on the windshield of the car in real time with a DLP projector. Here is a quick mockup of the flow of how this project would work:
What could we do with this feed of real time data that is projected on the windshield? Imagine driving down the street and if there was a drier doing something you didn’t like – instead of road rage what you could do is launch an on-screen fireball at him and blow him up virtually! Almost like a video game, except safer since you don’t get shot. Here is an example of the windshield display:
Imagine if the Kinetics tracker could also take photos in color rapidly and the Raspberry Pi can perform Optical Character Recognition (OCR) on license plates and other objects and track them in real time. It could also potentially identify vehicles by their type – and potentially even their make and model. Certainly trucks and jeeps and certain sports cars have very unique profiles.
Theoretically it could even allow you to drive a wee bit in the dark with a pseudo-night-vision – detecting objects in your path you might not see moving – like a deer off to the side.
If the Raspberry PI had Wifi and GPS available then it could also pull some real time information on the currently GPS position from Google Local , Yelp, Wikipedia and other databases and project Arrows pointing to such local attractions. Possibly it could even spot parking spots at oblique angles before you even notice them! Let’s crack this up and see what it can do.
I think the practical application of this is quite broad, but these are my initial goals to hit. One of the challenges in this is to find a way to see the projector on the windshield in the daytime. In this regard I have done some research – and it”s going to be hard to figure out. There is special treated glass , and there are some third party spray on products, and some companies that say they have developed a proprietary way to do it with any glass. Oh well – challenge excepted!
If you have any ideas on what else can be done with this setup feel free to hit me up and let me know.
by john threat on September 25, 2013
The Big Idea:
I got a chance to ride around the Tesla which blew me away. It’s like a iPad controlled giant battery on wheels. Well, unfortunately Tesla doesn’t make a 4×4 yet. My first thought was to get a junked Tesla and rip the dashboard and transplant it into my 97′ Jeep TJ Wrangler.
Then inspiration hit.
Here is what I used
Samsung Android TAB 3 10.1 : I snarfed this from BestBuy with a extended one year all inclusive warranty just in case something went wrong.
PLX Devices Bluetooth ODB II Scanner : If you want to use Torque for real time operating data from your car, you’ll want this.
Startech Right Angle Micro USB cable : To neatly connect it to the inverter.
Right Angle 1/8″ Mini-Pin Audio Adapter: To neatly connect the audio out from the tablet to the amp/speakers in the vehicle.
Speakercraft Automatic A/B Line Switch: Optional: If you want to run the audio from the tablet over your existing speaker and you have a one line amp.
Dremel : The magic device to cut into the dash neatly . They should teach kids how to use a rotary tool in school to stimulate the imagination.
I took the Dash Bezel off and to make room in a Jeep, I had to remove the climate control – I rarely use it. That might not work for everyone – and I also lose windshield defrosting abilities. Oh well, that’s what my hand is for. I used the dremel to cut in deep notches into two existing plastic posts that hold the dash bezel in place.
I took a second to clean up the wires and clean it off from burning man. Then easy as pie, the Samsung tablet slid right in. The bezel from the Empeg/Riocar in-dash Linux player also helped keep the Samsung Tablet nice and snug.
Then I threw in the right Angle Micro USB at the bottom to prevent the stock micro USB from getting bent and destroying the power charging port. I keep a 1500 watt inverter with USB ports behind the dashboard, so AC power wasn’t far. If you don’t have an inverter, you may have to get a car charger (which I would recommend cutting and tying directly to the prongs for the cigarette lights behind the dash).
Then I plugged in the right angle audio mini-pin so it would be flush with the tablet and ran that wire to the amp. You can also run it to the auxiliary input to your head unit, but I prefer having the Google map directions to play over the music from the head unit)
The Final step was the cut the Bezel. Now I am not a Dremel expert, but the next time I cut it – I know better how to tackle it. I pretty much cut off all the cross bars haphazardly, which is fine, to be able to access the hardware buttons. Next time I’ll do it neat and then reattach the crossbars for a better stock look – or I’ll make some on the 3d Printer when I get a chance.
A side bonus is that if you press down on the plastic bezel at the top, it will trigger the power button and volume buttons!
The functionality is so amazing and a Jeep is the one car where it looks better when things are hacked together. It still looks pretty nice and stock except for close up. I placed the bezel on, and I can see the whole screen from any angle. The forward firing camera is available for Skype, Google Hangout, Vine and Photos and Videos with the native Android app.
To really enjoy this setup you will need to be able to tether the Tablet to a WIFI source. They unfortunately don’t readily sell a SIM card version – but what I did was to wire in a WIFI hotspot from my mobile carrier into the vehicle. It wasn’t what I wanted as I had to run another power cord to keep it powered, but the upside is that any device I have near I can use the internet without touching the tablet – and in a pinch – I can take the WiFi from out the dash fast for other purposes where as the tablet isn’t so easy to extract.
By the way, the forward firing camera and microphone work 100% and very well. I can do voice searches and talk to people while driving with the top down at local road speed (10-40MPH).
For the final step – I connected the PLX Devices Bluetooth ODBII scanner under the dash in the speaker well. It draws power from the ODBII port luckily. It works well, but it does leave a cool red glowing going beneath the dash and obviously this is going to be a miniature draw off the battery if left sitting forever.
I haven’t checked other peoples lists yet, but a list of awesome in-dash car apps list is probably needed. Here is a list of apps i recommend that really worked awesomely me so far:
Torque: The Ultimate car app. You can run gauges of all types while you drive for real time and historical data. It’s truly amazing for those of us who love numbers and data – and then use it to adjust our equipment. Reads your ODB II info and works with your GPS as well to do cool stuff. Skip the free version and go right to the paid version – you’ll definitely want it.
Google Now: This is the new tool that pretty much acts like an amazing personal assistant. I love it. It calculates how long it’ll take to get home and to work, track airplane flights, yours and people coming to see you, and packages for you, (you can see my Carhartt Long sleeve shirt is on it’s way) track your meetings and more. It’s still evolving but I am already hooked and keep it up on the front screen and check the full screen version often.
Google Maps: Big Daddy! The best map and turn by turn navigation on the map with satellite terrain – and it works all over the place – from the streets of L.A. to deep into Death Valley – and it remembers your favorite and recent searches for quick returns to places. Drop a pin in a place you want to explore and it will get you there. The downsides is that is should be easier to save a place permanently and you should be able to swap what side the navigation arrow goes on.
My Tracks: Awesome app that tracks a line on Google map for you – so even if you lose a signal you can find your way back. You can also share the track on social networks or just keep a running tab where you have been yourself by easily dropping pins. It includes all types of metadata like speed and altitude on your trip as well. Then you can share your track or save it for later!
Gmail: Short description: Awesome email client and easy to read and navigate on the tablet. Beautiful and now if someone is taking too long to come back to the car, who cares! I’m doing business! Of course what is nice is addresses and contact info and other links Google processes open the corresponding apps nicely (maps, calendar, etc)
Tablet Talk: Awesome app that lets the text messages from your phone appear on the tablet. You can also send texts back to them from the Dashboard now! It’s also shows if someone calls and you can take the call as well! This is really awesome tooling around town or hooking up with friends, or picking someone up from the airport by being able to see the text as you are driving. You can set it to reconnect automatically as soon as you get in the car.
GoPro: Come on – connect to exterior mounted gopros? Awesome. Backup camera? Record crazy stuff at will without getting out of the car? Change settings on the fly from the car on all the cameras? A Must have for the Go Pro Hero 2 and 3. I’m totally in love with this – the only issue now is that you have to jump onto the cameras wifi , which means no internet- awww.
Zello: This is a walkie talkie push-to-talk application. You have to make an account, but it allows you to sort of radio to your car without making a phone call or text. You’ll still need a signal . but it allows me to pretend my Jeep can talk when I am not standing near it. It scares the stuffing out of people. It’s also good for co-ordinating movements with people with picking them up without worrying about making a phone call or holding a phone up while driving. I’m into this.
Skype: Oh yeah, now you can skype (or google hangout) with people while driving or parked. I recommend parked – but it def kinda awesome to connect to people from the drivers seat to catch up or do a quick conference call for work.
DS Video and Other Synology Apps: If you have a Synology NAS these apps let you connect with your home server to pull up media and documents. Stream movies and music to your dashboard from home, or maybe you need that PDF of a report to mail to someone? Just to turn it up, there is DS Download which lets you add torrents in the field, so basically – well you can watch it when you get home.
Pandora: I know some people like other services, but I find i discover the most amazing arcane records on Pandora. One issue is that their navigation on android tablets is t-e-r-r-i-b-l-e . The plus side is I am considering a paid subscription because getting video ads while driving and blasting music is jarring and eating up bandwidth.
Yelp: Come on, Yelp has made itself indispensable to quickly find things like Jamba Juices or a good sushi spot. It does quite a bit more – and using Monocole on the dash works better than when walking.
Voice Search: Yup! Works well – both google and samsung voice search. I lean toward using google voice search more just because those are the apps I am using the most.
Camera: Come on, taking action shots and videos of all your friends while driving and having fun is awesome. You can even voice trigger the photos if you like, by saying things like Cheese! , Play with the settings, there are plenty. The default camera app is really well thought out and mega fun from the drivers seat! A new dimension in selfies.
Phone Fusion Visual Voicemail Plus: I favor this – for some reason – everyone kept me away from Google Voice. Well I use this to visually see a list of my voice mails and play them from the dashboard. I can forward them via email and save the .wav file to stop you from suing me later. You can have them transcribed for a price too – which I am considering paying for.
Pulse: My personal preference for a visual style newsreader. Easy to add news sources. Awesome in every way and as widgets for easy reading on the home screen. Highly recommended
Music Visualizer: Awesome large screen visualization, works with music players on the tablet, as well as taking input from the microphone.
Challenges and Errors:
Heat: Right now I’m driving thru the desert a lot, and it looks like it survived sustained 120+ degrees heat multiple times. It did give me warnings galore about temperature and charging. I realize heat can kill or degrade the systems in the tablet, and its taking massive heat from the firewall and whatever still seeps thru the air ducts. I’ll have to figure that one out. It doesn’t complain till its over 110 degrees in the air and the jeep is running for a while.
Security: Come on, this is probably begging for someone to steal it, at the same time – dash board screens are so prevalent, it doesn’t really look special from a distance. I turn the screen off when I leave. What I’d like to do is get a 3D plastic print of a black door to cover the screen when I leave the car unattended for a long time in a public place. Also – if anyone has ideas how I can lock it to the dash more securely , please send your suggestions. So far though – so good!
App configuration: Some apps don’t play well in forced landscape. Very few but they are out there. Some have terrible navigation , like Pandora. Some apps still could use more configuration options (like it would be nice to swap what side the turn directions go in Google Maps/Navigation for instance)
Danger: Lets face it, with all this stuff at your finger tips – you might be tempted as a driver to use stuff other than maps or music visualization while driving. So here is a disclaimer – of course if you choose to do this, this is of your own accord. You have to pay attention to the road when driving. Flashing your eyes at a incoming email or text title on the screen at a long red light is one thing. Engaging in reading and writing emails and text at 60mph or more is dangerous and irresponsible.
Brown Color: The Samsung Tab if you go that route only comes in White and Brown. I chose Brown. I wanted black – color me disappoint. I am trying to weigh my options for covering the brown bezel on it with black without covering the camera. You don’t notice it at night but in sunlight, it’s brown. I’ve forgotten it’s brown over time.
Start From USB: I am already on push button start, but what If I could start the car from the USB port? Or from the Wifi network? Totally doable. I have to get on it.
Well let me know what you think — I’ll answer your email as soon as I park.
by john threat on September 25, 2013
Oh Yeah! So we finished up Monsters. It’s a show about two horrible Monsters , Dick and Dash , that are roommates that fight, curse, drink,
fuck, take drugs and smoke – in other words it is a story about heartfelt friendship. We rocked out three awesome pilot episodes with a raft of talented actors (Daniel, Marc, Bettina, Al, Mina and more – thank you!). We then had a quick screening among friends to see what people thought:
Oh shit! They loved it! Now what. It has touches of The Mighty Boosh, The Young Ones, The Odd Couple, Pee Wee’s Playhouse, Adventure Time and yet it is it own thing you’ve never seen before. Check out a few still below from the show:
Okay – so I have an idea. I packed up my Jeep Nomad with an insane PDF 24 episode guide and bible of the show along with 3 pilots that are nose bleed intense and I’ve headed toward L.A.: big city of dreams to kick it with like minded people who like to make heart rending touching pieces of comedy with a deep felt humanity that just happen to have an occasional piece of shit on the screen. Is that so wrong?
So if you are in L.A. and you wanna toss back a high IPA beer or 12 year old whiskey in Silver Lake or Echo Park, let me know.
by john threat on September 20, 2013
I rushed head first into the 3D printing revolution – it’s the stuff dreams are made of. One thing that bothered me was the smell and airborne residue of burning plastic in a small New York apartment – but with the current generation of 3d printing you still need to keep an eye on the build process. So I came up with the idea of converting a utility closet into 3D printer closet! It’s really attractive and works well – now I don’t have to smell anything and worry about breathing in fumes.
It’s pretty simple. Take the door down , draw a level square on it and then cut it out.
I grabbed some plexiglass from home depot and glued it on the other side. Some tape held it in place to make sure it didn’t fall out before the glue dried.
Take this time to put a cooler handle on it. I really wanted to put a hi-tech LED handle on it but I haven’t found one yet. (Keeping an eye on this one!) – So I threw a fancy stainless steel handle on it that looks awesome – but it isn’t what I really want.
This project only took about a two hours including a drive to Home Depot for the plexiglass, glue, wood, spray paint and tape. I have a Makerbot Replicator 2 which i bought just because of looks, but its not really my first choice for a 3D printer. One of the things that sucks is that it isnt internet aware, which means i have to bring a SD card over to it. Too bad it doesnt have WIFI or ethernet – all the best printers too. I screwed myself on that one. Oh well – get up lazy. (WIFI STILL BETTER)
I also installed HUE lights all over my apartment on a suggestion from highly recommended entertainment and business lawyer Quinn, which makes the lighting look even more amazing. With all the stuff you can do with HUE lights from Phillips – I’ll have to write something up on that separately that shows off what it can do when hacked into everything in the place. (if only the 3d printer had WiFi then it could totally alert me on a finished print by blinking all the lights!)
Sorry my apartment is such as wreck – but I didn’t fix it yet from finishing the shoot on Monsters. All in all it came out awesome as functional eyecandy!
by john threat on May 24, 2013
So rumbling in the pipeline is a video for MNDR: Faster Horses.
MNDR is a talented artist who I was double super lucky , no like mega lucky to work with. We met and tossed up some whiskey and she introduced me to Guy Maddin: Sissy Boy Slap Party
Man! That is genius, no? I love that short film – it’s like in me top ten now. I love what she and Peter Wade did on the “Feed Me Diamonds” album and I was pumping in the Jeep Off Road and i swear I wrote like five treatments – the one she picked was also my favorite – Daymare! Inspired by the lyrics and music I took all the girl’s dreams I’ve ever heard and transposed them on a side scrolling video game thematic. She literally travels thru different spheres of the dream state to reach the inner sanctum sanctorum to free herself! Its a frame one to frame end adventure and it’s be out faster than you can shake a stick. Here are a few photos:
by john threat on April 24, 2013
Sterogum the awesome music site debuted the MNDR/Faster Horses music video I directed. Spin also had a great write up!
by john threat on March 4, 2013
DayWalker attempts to literally record your whole day and condense it into a music video at night and upload it to YouTube. Imagine smashing your ennui with your mundane existence enhanced with soundtrack – and instant Kafka-esque Die Verwandlung of your journey through this world. DayWalker explores your environment both online and off and mashes it up into a short film that you can save for posterity or share with friends. You can even analyze it for connections and patterns you didn’t even know existed, like Albert Brooks in “Defending Your Life“.
So things are progressing rapidly thanks to the Raspberry Pi! Let’s take a look at the hardware spec first:
So DayWalker hardware consists of a Raspberry Pi as it’s brain – outfitted with a shiteload of things to interact with the environment around your. GPS – to grab your position on the planet. Bluetooth and WiFi to scan all devices and networks that are near you. A microphone to catch and analyze all the audio around you and break it down into words and relate that to your day as well. Let’s wrap the package up nicely with a touch screen that let’s you know the status of the device, and on-off switch and a rechargeable lithium-ion battery all wrapped up in a custom 3D printed case with two arms straps.
Now let’s drill down into the meaty software spec:
WTF? Okay the short of it is this unwieldy Plesiosaurs of a diagram. The right side of the diagram represents the real-time data collection from the sensory devices attached to the Raspberry Pi which is stored in the DayWalker‘s Database. This includes WiFi network names, Bluetooth phone names – possibly phone calls from your own phone, music playing near the device, conversations that you have and of course the very section on earth you are standing on.
At the end of a set time period (midnight!) , or at any time the user of DayWalker can trigger it to generate a video of what it has collected. Then the Middle of the diagram kicks in collecting additional data from the last period from various social media sources of the user : I.E: Instagram, Twitter, Google calendar, Facebook, Flickr, and other social networks to generate the video.
All this goes to the render engine that begins to pull photos for all the processed audio it has heard during the day, and match photos and positions to WiFi networks, map locations, calendar events, etc. It then beat matches a nice piece of music, or several pieces depending on the length of the video. After compiling it – it uploads it to a youtube account of your choice!
Additional software processes run a web interface for real -time monitoring and input and output to the touch screen for setup and real time updates.
Now that the idea has been laid out clearly – Let’s shake the caboose and see what comes loose.