opsview = new opsviewrestapi('my.opsview.server',3000)
opsview.proxy('/RESTProxy.php');
status = new opsview.api('status');
status.ops.state = '2';
status.ops.filter = 'unhandled';
status.get(function(data){
  console.log(data);
});

So what did I do here?First, I defined my server in the opsviewrestapi and his port. Then I defined the Proxy page.What happens in the background?All request are send to the proxy php page instead of going directly to our opsview server. Everything is the same, except the client class adds 2 headers extra with the request. Take a look at the request:

request-URL:http://my.web.server/RESTProxy.php/rest/status/service?state=2&filter=unhandled
requestmethod:GET
Statuscode:200 OK
request headers:
 Accept:application/json
 Content-Type:application/json
 DNT:1
 Referer:http://my.web.server/opsview/index.html
 User-Agent:Mozilla/5.0 (Macintosh; Intel Mac OS X 10_7_3) AppleWebKit/534.53.11 (KHTML, like Gecko) Version/5.1.3 Safari/534.53.10
 X-Opsview-Token:cdb5c6d0c66e3b7ff331d872ceecfaa3c9f7f62b
 X-Opsview-Username:admin
 X-Requested-With:XMLHttpRequest
 x-RESTProxy-Host:my.opsview.server
 x-RESTProxy-Port:3000

See what happened here? the REST API location path is just added to the RESTProxy.php location (apache supports this out of the box), the whole request is just the same as directly to the opsview server except for the last two headers:

x-RESTProxy-Host
x-RESTProxy-Port

These headers are captured by our php rest proxy, deleted of the header list and the whole request is forwarded to the defined server with curl.

The output of the curl request is then returned to our javascript client class just as we expect it with a few differences:

Connection:Keep-Alive
Content-Length:989
Content-Type:application/json
Date:Sun, 26 Feb 2012 11:48:19 GMT
Keep-Alive:timeout=15, max=98
Server:Apache/2.2.14 (Ubuntu)
X-Powered-By:RESTProxy - PHP/5.3.2-1ubuntu4.14
x-RESTProxy-connect-time:0.000108
x-RESTProxy-download-content-lenght:989
x-RESTProxy-namelookup-time:2.8E-5
x-RESTProxy-redirect-time:0
x-RESTProxy-size-download:989
x-RESTProxy-size-upload:0
x-RESTProxy-speed-download:5460
x-RESTProxy-speed-upload:0
x-RESTProxy-start-transfer-time:0.181103
x-RESTProxy-total-time:0.181115
x-RESTProxy-upload-content-lenght:0
x-RESTProxy-url:http://my.opsview.server:3000/rest/status/service?state=2&filter=unhandled

There are some debug headers added if there is a problem with the proxy.

So there you go! take a look at the code on github: http://github.com/subutux/RESTProxy

After moving our Opsview server to a “real” server (before it was a virtual machine, begging for more RAM), I started experimenting with the REST API of Opsview. First in PHP. Was fun but I wanted to load the data dynamically in javascript. So, I wrote a javascript client class for the Opsview REST API. It works pretty sweet! The usage is quite simple if I may say so:

//first we declare our opsview server. !Note! Cross domain scripting is not allowed,
//so this code must run on the same server as Opsview!
opsview = new opsviewrestapi('../');
//authenticate
opsview.authenticate('admin','initial',function(data){
	// if authentication succeeded, execute this code

	// Create a new api call
	hosts = new opsview.api('status/host');
	// We set our options
	hosts.ops.host_state = '0'; // Only UP hosts
	hosts.ops.host_state_type = 'hard'; // With a hard state type
	//do the request
	host.get(function(data){
		for (host in data.list){
			// show the up hosts in the body
			$('body').append('<div>UP - ' + data.list[host].name + '</div>');
		}
	});
});

Explanation

opsview = new opsviewrestapi('../');

In this example our server is http://opsview with the html containing the above javascript at http://opsview/test/demo1.html. In the above example we define ‘../’ as the server location of opsview. Why? because cross-domain scripting is not allowed by the browser. I’ve made a workaround for this but more on that later in another blogpost.

opsview.authenticate(user,pass,success(data),fail(xhr));

Pretty straight forward I think? Success is executed when the request was successful and we got a login token. fail is run when there is an authentication error or request error.

hosts = new opsview.api('status/host');

Now this is the fun part! See what i did here? the opsview.api parameter is acutally the url for the REST API after the ‘rest/’ part. So what’s in this host variable now? Let’s see:

hosts = {
'url' : '/rest/status/host', //the full url of the REST API. Can be used to add GET parameters to a POST method
'ops' : {}, // An object containing the request parameters. if the request method is GET, this will be used as url parameters, else it's used in the request body.
'method' : 'GET', // Informative default method
get(), // GET the results *
post(), // POST the results *
put(), // PUT the results *
delete() // DELETE the results *
}

the post(),put(),delet() functions are only available when the REST API supports it.

So  that’s about it then. I’ll upload the client soon. But first I need to explain you my REST API Proxy. that’s for another time.

Update: here’s the GIT: https://github.com/subutux/opsviewrestapi-js

Update2: Little side-note: I’m using the jQuery lib. Just a headsup!

This logging function has the following features:

• Custom log location:
  define the relative path for your logfile. Make sure the path is writable for the webserver user (under ubuntu this is www-data)
• Log levels:
  You can define from witch log level there should be logged.
• App names:
  define witch section/function this log line is from

Examples:

logger('ajaxPost->time',"Time is set at".$time); //Default loglevel 1
logger('ajaxPost->time',"Time is set at".$time,"2"); // loglevel 2
logger('ajaxPost->time',"Time is set at".$time,"3"); //loglevel 3, will not be logged because smaller than $logger['LEVEL'].

Enjoy!

<?
$logger['PATH'] = "/var/www/logs/master.".date('Ymd').".log";
$logger['LEVEL'] = 2;
function logger($name,$mesg,$level = 1){
	if (isset($_SESSION['username'])){
		$u ="[".$_SESSION['username']."]";
	} else  $u = "";
        global $logger;
	//echo $level;
	if ($level <= $logger['LEVEL']){
	        $line = date('M d Y H:i:s')." [".$name."]".$u.": ".$mesg."\n";
	               //Jan 07 2010 22:10:41 [MySection] :
	        $f['fh'] = fopen($logger['PATH'],'a')or die("can't open file ".$logger['PATH']."!");
	        fwrite($f['fh'],$line);
	        fclose($f['fh']);
	}
}
?>

I recently bought myself a magic mouse. In the first place to use it with my MacBook Air (such a sweet laptop!) but why shouldn’t I use it on my ubuntu pc? The initial configuration is as easy as other bluetooth enabled hardware. Choose from the bluetooth applet drop down menu “Configure new device…”. Make sure your mouse is turned on (the little switch at the bottom of the mouse). Choose your mouse from the list and use the PIN “0000″. When your magic mouse is paired, the little green light at the bottom of your magic mouse stops blinking and lights up green. Now you can use your magic mouse as a normal mouse but, multi-touch & scrolling doesn’t work.

After some searching on the ubuntu fora, I’ve found this post : http://ubuntuforums.org/showthread.php?t=1534190
Apparently, the magic mouse works out of the box in 10.10 :

I just got my magic mouse and was expecting problems, but to my delight scrolling works out of the box. I’m running an up to date 10.10 (alpha?) with kernel 2.6.35-13. I guess all the drivers have been inserted into the new kernel. Haven’t tried any 2-finger zooming etc as yet.

Some dude maintains the backports for Maverick (10.04) of the Magic Mouse drivers on his github:http://github.com/scottferg/multitouch

Head over there and download the tarball. unpack it and open an terminal and head over to the directory where the source of the drivers are. run the following:

sudo apt-get install cdbs

dpkg-buildpackage -rfakeroot -b

cd ..

sudo dpkg -i multitouch-kernel-source_1.5_all.deb

reboot your pc, connect your mouse (make sure bluetooth is active, power on the mouse, wait a few seconds and click the mouse) and enter the “0000″ pin. Scrolling on the x & y axes should work now.

Another dude made a python script for multitouch gestures on the gnome desktop:

Hardcore hacks ahoy. If you use my kernel driver and follow these instructions you can get PyMT up and running on Lucid. PyMT requires an application to be running on the desktop, but continues to accept input whether or not the app has focus (or is minimized). Because of this, I was able to hack together a rough implementation of multitouch gestures for the desktop.

Swiping left/right with two fingers will rotate the cube. Swiping down with three fingers will call up Expose. In order to use this you will need the Dbus, Scale, and Rotate Cube plugins enabled in Compiz. I also had to be a little dirty and apply:

Code:

$ sudo chmod a+r /dev/input/event7

in order to run the app as the current user. Without this, Dbus can’t connect to the running session.

Here’s the Python file: http://gist.github.com/546779

PyMT installation instructions for Lucid: http://pymt.eu/wiki/DevGuide/InstallPymtUbuntu
PyMT configuration instructions for Ubuntu: https://wiki.ubuntu.com/Multitouch/PyMT

I haven’t tried this out. Let me know ( and the dudes on the forum post ) how it works for you!

Update: Turns out PyMT stands for Python Multi Touch, and is kinda a python library for multi touch gestures. This dude above created a python script that uses multi touch gestures to interact with your (compiz) desktop.

• 3 finger swipe up:
  show desktop
• 3 finger swipe down:
  exposé
• 2 finger swipe left:
  rotate desktop cube left
• 2 finger swipe right:
  rotate desktop cube right

If you follow the instructions, it’s easy to install!

Handbrake server wants to be a server version of the popular Handbrake application for video conversion. It allows to read video files from shares or uploaded files and converts these files to itunes compatible formats for you to enjoy.

But why?

Because there is a need for this. Why burden your pc when you got a home server running that can do the job for you? Just choose the movie you want to convert and the server will let you know when the conversion is complete. Also, this is where speed comes looking around the corner. Install this on a blade server and it flies m4v’s!

What technology will you use?

I’m thinking of using a basic apache2 server with php5. Some bash scripts and maybe some cgi coding to replace the bash scripts. I will use the cli version of HandBrake.

hey, I’ve got an idea!

tell me! (comments or mail)

Hey, I’m a pro in … Do you need help?

YES! Help is always welcome. If this project kicks off really well, I’ll put up a mailing list etc etc

[global_config]
[keybindings]
  toggle_zoom = <Ctrl><Alt>Z
  split_vert = <Ctrl><Alt>V
  split_horiz = <Ctrl><Alt>H
[profiles]
  [[default]]
    use_system_font = False
    background_darkness = 0.82
    background_type = transparent
    scrollbar_position = hidden
    foreground_color = "#00ff00"
    icon_bell = False
    font = Monospace 9
    scrollback_infinite = True
[layouts]
  [[default]]
    [[[child1]]]
      type = Terminal
      parent = window0
    [[[window0]]]
      type = Window
      parent = ""
[plugins]

ProFTPD is a advanced ftp server that is extendible with modules and the config is pretty straight  forward (markup us equal to that from apache.conf). I also found a good web ui for ProFTPd with mysql logging,quota support, user management, group management, system resources, etc. named ProFTPd Administrator.

Because setting this up was a slight pain in the ass, here’s an howto for the ubuntu folks !

Step 1: preparation

make sure all the needed packages are installed:

sudo apt-get install apache2 php5 mysql-server mysql-client proftpd proftpd-mysql phpmyadmin

• Choose a password for the root account in mysql and write it down somewhere (or remember it, even better!).
  quick tip: for easly ‘rememberable’ passwords, use pwgen. Pwgen generates hard to guess, but easy to remember passwords.

• For phpmyadmin, choose apache2 configuration.

Go to your www-root and download proftpd-adm:

cd /var/www/
wget http://sourceforge.net/projects/proftpd-adm/files/proFTPd%20Administrator/proFTPd%20Administrator%20v1.2/proftpd_admin_v1.2.tar.gz/
tar vxzf proftpd_admin_v1.2.tar.gz
mv proftpd_admin_v1.2 ftp

Step 2: Installing the mysql user and table

Go to /var/www/ftp/misc and edit the database file.

cd /var/www/ftp/misc/database_structure_mysql
vi (or your favorite text editor) db_structure.sql

and change the last lines as followed:

GRANT ALL ON usertable proftpd_admin.* TO proftpd@localhost IDENTIFIED BY ‘SomePass‘;
GRANT ALL ON grouptable TO proftpd@localhost IDENTIFIED BY ‘<database_password>’;
GRANT ALL ON xfer_stat TO proftpd@localhost IDENTIFIED BY ‘<database_password>’;

Changes are displayed in bold, changes that needs your specific input are displayed in bold italic.
Things that needs to be deleted are striketrough.

Now we need to create the database and fill it with the tables, like this.

mysql -u root -p < db_structure.sql

Test this by executing the following (you will be prompted for the proftpd password you changed above):

mysql -u proftpd -p proftpd_admin
mysql> show tables;
+————————-+
| Tables_in_proftpd_admin |
+————————-+
| ftpquotalimits          |
| ftpquotatallies         |
| grouptable              |
| usertable               |
| xfer_stat               |
+————————-+
5 rows in set (0.00 sec)

Step 3: configuring proFTPd

make the ftp dirs and correct the rights:

mkdir /ftp
chown nobody:nogroup /ftp
chmod 0660 /ftp
mkdir /ftp/incoming
chown nobody:nogroup /ftp/incoming
chmod 0660 /ftp/incoming

Save the default config under another name:

cd /etc/proftpd
mv proftpd.conf proftpd.conf.default

and copy the one from the proFTPd Administrator package & edit:

cp /var/www/ftp/misc/sample_config/proftpd_quota.conf proftpd.conf
vi proftpd.conf

As above, changes are displayed in bold, changes that needs your specific input are displayed in bold italic.
Things that needs to be deleted are strikethrough.

ServerName                      “Server”
ServerType                      standalone
ServerIdent                     on              “Server”
DeferWelcome                    on
DefaultServer                   on
DisplayLogin                    .welcome        # Textfile to display on login
DisplayConnect                  .connect        # Textfile to display on connection
DisplayFirstChdir               .firstchdir     # Textfile to display on first changedir

UseReverseDNS                   off
IdentLookups                    off

Port                            21
Umask                           022
MaxInstances                    15
MaxClientsPerHost               3               “Only %m connections per host allowed”
MaxClients                      10              “Only %m total simultanious logins allowed”
MaxHostsPerUser                 1
Include                         /etc/proftpd/modules.conf
User                            nobody
Group                           nobodynogroup
[...]
# Set up authentication via SQL
# ===========
AuthOrder                       mod_sql.c
SQLAuthTypes                    Backend
SQLConnectInfo                  proftpd_admin@localhost proftpd SomePass
SQLUserInfo                     usertable userid passwd uid gid homedir shell
SQLGroupInfo                    grouptable groupname gid members
SQLUserWhereClause              “disabled=0 and (NOW()<=expiration or expiration=-1 or expiration=0)”
[...]

ProFTPd Should be configured right now with quota support & authentication via a mysql back end.

try to start the service:

service proftpd restart

If it returns ok, you win! Else, post the errors you’ve got in the comments below.

Step 4: Securing ProFTPd Administrator

Security first! Whe are going to secure our /ftp webdirectory with use of apaches build in httpauth.

edit the default site:

vi /etc/apache2/sites-available/default

Again, changes are displayed in bold, changes that needs your specific input are displayed in bold italic.
Things that needs to be deleted are strikethrough.

<VirtualHost *:80>
ServerAdmin webmaster@localhost

DocumentRoot /var/www
<Directory />
Options FollowSymLinks
AllowOverride None
</Directory>
<Directory /var/www/>
Options Indexes FollowSymLinks MultiViews
AllowOverride NoneAll
Order allow,deny
allow from all
</Directory>
[...]

Now we create the .htpasswd file. For maximum security, I place this in my apache /etc/ dir

htpasswd -c /etc/apache2/.htpasswd root

Enter your password as you wish.

Go to /var/www/ftp/ and create the .htaccess file

cd /var/www/ftp/
vi .htaccess

AuthType Basic
AuthName “Restricted Area”
AuthUserFile /etc/apache2/.htpasswd
Require user root

Now restart apache2 to apply your changes;

service apache2 restart

Step 6: Make a little change to ProFTPd Administrator code

edit the class_system.php file on line 196 to fix the module problem:

#exec($GLOBALS['config_path_to_proftpd'] . ‘ -l’, $modules);
#Fix for ubuntu
exec(“cat /etc/proftpd/modules.conf | egrep -v \”^#\” | egrep -v \”^ModuleControlsACLs\” | sed ‘s/LoadModule //g’ | egrep -v \”^ModulePath\”",$modules);

Step 7: Configuring ProFTPd Administrator

make sure configuration.xml is writable to apache:

chown www-data:www-data /var/www/ftp/configuration.xml

in your webbrowser, go to [ip-server]/ftp/configure.php
login with your credetials as mentioned above.

Database

Enter the information as followed:

• username: proftpd
• password: SomePass
• Hostname: localhost
• Database: proftpd_admin
• Database server : mysql
• Subtype: Standard

ProFTPd

Enter the information as followed:

• FTP root: /ftp
• Default home directory: /ftp
• Create user command: empty
• Delete user command: /bin/bash /var/www/ftp/misc/user_script/delete_user.sh
• Default shell: # /etc/shells: valid login shells

Filepaths

Enter the information as followed:

• who: /usr/bin/who
• df: /bin/df
• ps: /bin/ps
• sysctl: /sbin/sysctl
• ftpwho: /usr/bin/ftpwho
• Kernel configuration file: /boot/config-2.6.32-25-generic (check in your /boot the latest config file)
• proftpd: /usr/sbin/proftpd

Extentions

• Quota: enabled
  (if you can’t select enabled, check if you entered the above hack correct and include /etc/proftpd/modules.conf is present in your /etc/proftpd/proftpd.conf file.)

Step 9: Success!

Done! try to create a user in Users > Create User and try to login. Set some quotas, etc. Play with it and get to know the interface!

If you’re stuck somewhere, leeave a comment and I’ll try to help you out.

Second, For this new year i’ve got some new years resolutions I would like to talk about.

Projects,projects,projects

After all, this is a coding blog

I’ve got some projects “running” that are never/allmost worked out or stalled that i like to finnish.

Copycat

For those who’ve got the dev url and experimented with our latest build, i’m pleased to announce that the dev build will be the last build. All things are in place (and working) so I’m proud to say, Copycat is finnished! The new version will be pushed to you when i activate the new build. More on that later on.

handbrake-server

Yes, i’m building a handbrake server! thanks to a friend of my (stephsd3) i’ve now access to a cloud based enviroment build on some blade servers, perfectly for converting movies rapidly & pure testing. I’ve started to work things out, designing the freakin’ thing, background coding and it looks good! There will be a server and a client based app. The client, coded in Adobe AIR, will upload your movie, allows you to alter the convertion setttings, covert the movie and notifies you when it’s done. A lot of coding needs to be done so, this could take a while. (especially on the server side).

Cli tools & commands & shell scripts

Yep, I will keep posting some command line tools etc. for you to hack on/use.

Reviews

Oh yes! There will be reviews of apps/plugins/scripts/code/methods/… this year.

So this is what i’m up to for this year. The only difference from last year is that i’ll try more to finnish my running projects/ideas.

Happy 2011!

#!/bin/bash
publicip_=`curl -s --connect-timeout 3 checkip.dyndns.org | sed 's/[^0-9\.]//g'`
echo $publicip_

save it as publicip under /usr/local/sbin/ and execute chmod +x /usr/local/sbin/publicip . whenever you need the public ip, just run “publicip” from the terminal and it shouts out your current public ip.

you’re welcome.

]]> http://blog.subutux.be/2010/11/29/quickly-obtain-your-public-ip/feed/ 0 http://blog.subutux.be/2010/11/15/introducing-isohunt-mobile-a-poc/ http://blog.subutux.be/2010/11/15/introducing-isohunt-mobile-a-poc/#comments Mon, 15 Nov 2010 17:37:05 +0000 subutux http://blog.subutux.be/?p=265 Whenever I need do download a torrent, I go to isohunt. Isohunt is a torrent site that catalogs a wide range of torrent sites all in one place. And they have a public API. Also, I’ve always wanted to test out jQuery Mobile, It’s a universal theming/javascript platform/class that works with a wide range of mobile devices out of the box! (android,iPhone,blackberry,…). Here was my chance to make somthing usefull. I started coding a simple mobile interface for Isohunt. A searchbar. Results where fetched via the public API (json whohoow!) and drawed in a nice list layout. Then I tought, hey, let’s combine this with transmission ! It also has a public API (also json, Double Wohoow!) so after 4 hours of coding, I’ve got my PoC (Proof of Concept).

It works. Test it out!

http://ihm.subutux.be (open in this browser, or your mobile device)

Don’t forget to configure your transmission settings (Saved in local cookies, no data is kept on my server)

Leave a comment and lemme know what you think!

Update: Apparently isohunt has blocked me from their api Not cool dudes, NOT COOL!

Update2: Apparently isohunt changed there API and uses a header redirect now. Fixed it!