I’ve been messing with Apache Spark quite a bit lately. If you aren’t familiar, Spark is a general purpose engine for large scale data processing. Initially it comes across as simply a replacement for Hadoop, but that would be selling it short. Big time. In addition to bulk processing (goodbye MapReduce!), Spark includes: SQL engine Stream processing via Kafka, Flume, ZeroMQ Machine Learning Graph Processing Sounds awesome, right? That’s because it is, babaganoush.
- In this tutorial I’ll be guiding you through setting up a headless Ubuntu 11.10 box that you’ll manage using virt-manager, accessed via X11. My main machine is a Mac running OSX Lion. You’ll need the Ubuntu CD, and for the first part of the tutorial, physical access to the box with a keyboard and monitor. **Install Ubuntu on your server. ** I installed Ubuntu Desktop so I could mess with virt-manager before I disconnected everything.
- The NETGEAR ReadyNAS is a pretty sweet product if you’ve got a small team like I do. It’s inexpensive and easy to set up. Log into the ReadyNAS and turn on Rsync for your backup share. Optionally, set a username and password. Your ReadyNAS will start up it’s rsync daemon. Replace the password and IP below with the rsync password and IP of your NAS, and use the share name in the rsync command - mine was “backup”.
- c++ mysql xcode I need to compile something and use the MySQL C++ library. I have mysql and mysql++ already compiled, I won’t go over how to do that now. I added the following code to the top of my source: #include <mysql++.h> I got an error /Users/jhaddad/dev/search_engine/main.cpp:4:21: error: mysql++.h: No such file or directory Not cool. How to fix: In XCode, open up the project settings (under the project menu).
- Curl is a fantastic application. The most basic use of curl is very straightforward, just put in a web site’s url: curl http://twitter.com If you copy and paste the above code, you’ll get the HTML output of twitter’s home page. In order to demo this, I created a twitter account. You can sign up for one on your own. Now, to hit their api and update your status, they require you use HTTP Basic Authentication.