Moving to jekyll on github

hey! I'm moving this blog to another platform.

It will continue on https://jumpifzero.github.io/

Thanks

SAP call SQ01 query and get results

This is way too hard for something so simple so I'm posting it here.


data: lr_data type ref to data,
      lt_seltable type TABLE OF rsparams,
      ls_seltable type rsparams.

ls_seltable-LOW = '20160427'.
ls_seltable-SIGN = 'I'.
ls_seltable-OPTION = 'EQ'.
ls_seltable-SELNAME = 'SP$00001'.
ls_seltable-kind = 'S'.
append ls_seltable to lt_seltable.


CALL FUNCTION 'RSAQ_QUERY_CALL'
  EXPORTING
    WORKSPACE                         = 'G'
    QUERY                             = 'name_of_query'
    USERGROUP                         = 'name_of_group_in_sq01'
*   VARIANT                           = ' '
*   DBACC                             = 0
    SKIP_SELSCREEN                    = 'X'
    DATA_TO_MEMORY                    = 'X'
*   FREE_SELECTIONS                   =
 IMPORTING
   REF_TO_LDATA                      = lr_data
*   LISTTEXT                          =
*   LIST_ID                           =
*   PROGRAM                           =
*   USED_VARIANT                      =
 TABLES
   SELECTION_TABLE                   = lt_seltable
*   LISTDESC                          =
*   FPAIRS                            =
 EXCEPTIONS
   NO_USERGROUP                      = 1
   NO_QUERY                          = 2
   QUERY_LOCKED                      = 3
   GENERATION_CANCELLED              = 4
   NO_SELECTION                      = 5
   NO_VARIANT                        = 6
   JUST_VIA_VARIANT                  = 7
   NO_SUBMIT_AUTH                    = 8
   NO_DATA_SELECTED                  = 9
   DATA_TO_MEMORY_NOT_POSSIBLE       = 10
   OTHERS                            = 11
          .
IF SY-SUBRC <> 0.
* Implement suitable error handling here
ENDIF.

SAPUI5 DatePicker backed by sap internal date format yyyymmdd

new sap.ui.commons.DatePicker({ 
 value: { path: "/KEYDATE", 
    type:  new sap.ui.model.type.Date({
     source: {pattern: "yyyyMMdd"},  
     pattern: "dd.MM.yyyy"})
}}),

How to manage browser cache on SapUI5 / OpenUI5 applications - CacheBuster

The problem: you have an SapUI5 / OpenUI5 application currently being used and you want to change something to it. How do you force users to start loading the latest version?

Webapps are comprised of objects loaded via HTTP. These objects are mostly, images, html, javascript or css files. All these files are served with a validity date that can be set on the server. Browsers, for performance reasons, only load an url if they don't already have a copy of that resource in their cache or if the copy's validity already expired.

On *UI5 apps we cannot easily set the validity of the objects loaded server side so the only way to force users to load a new version is to force a change on the url being requested. This can be done by appending a parameter, changing the name of the object (view/controller, etc.) or, using the CacheBuster feature on UI5 that does this automatically.

When using CacheBuster, everything that is loaded via the jQuery.sap.require function has a timestamp inserted in the middle of the url. Because this timestamp can be controlled by developers, they can force browsers to load the latest version of the urls.

So, instead of the browser making this example request:
https://<hostname>/sap/bc/ui5_ui5/sap/<projname>/<appname>/main.view.js
It does the following:
https://<hostname>/sap/bc/ui5_ui5/sap/<projname>/~20141018120538~/<appname>/main.view.js

 This timestamp makes the url unique and it theoretically contains the timestamp this object was last changed. When the application is first started, the framework does a request to an url to get a json that tells it the timestamps when each file was last modified. These timestamps are then automatically appended to all requests.
This url to this json is something like :
https://<hostname>/sap/bc/ui5_ui5/sap/<projname>/sap-ui-cachebuster-info.json

 How to enable cachebuster on your ui5 app?
Too easy, just append data-sap-ui-appCacheBuster="./" to the script tag that loads the ui5.
e.g.

 <!DOCTYPE HTML>
<html>
 <head>
  <meta http-equiv="X-UA-Compatible" content="IE=edge">
  <meta http-equiv="Cache-Control" content="no-cache, no-store, must-revalidate" />
  <script src="resources/sap-ui-core.js"
    id="sap-ui-bootstrap"
    data-sap-ui-libs="sap.ui.commons"
    data-sap-ui-theme="sap_goldreflection"
    data-sap-ui-appCacheBuster="./">
  </script>

Now, whenever you change the project or transport a new version, execute report /UI5/RESET_CACHEBUSTER on the backend. This report resets all these timestamps. I do not know if they are supposed to be reset automatically when checking in a new version or when transporting, but from my experience, manually executing is the only reliable way.

 Hope it helps

Extract MSI without admin rights

The following worked to install python on a windows machine without admin rights.

msiexec /a python-3.4.3.amd64.msi /qb TARGETDIR=C:\tiago\programas\python33

Finding and deleting duplicate files with fdupes

In a large tree of files, it is common to have duplicate files under different paths. Let's say you want to find them and possibly delete them automatically.
First install fdupes

sudo apt-get install fdupes

Now 'cd' into your directory.
To make a summary of how much space you can save by deleting duplicate files, execute the following:

fdupes -r -m ./

To really delete the duplicate files:

fdupes -r -d -N ./

-N means no prompt (deleting wihout asking anything)
-d means delete
-r means recurse into all subdirectories
without any flag fdupes will print, for each duplicated file, its duplicates, for all files that have duplicates

Clear sapui5 cachebuster cache

To clear cache on sapui5 cachebuster functionality run report /UI5/RESET_CACHEBUSTER on sap.

SapUI5 snippets

Get data of selected table row

var sPath = oEvent.getParameter("rowContext").getPath();
var oRowData = oModel.getProperty(sPath);
var oData = oModel.getData();

Route to another view (using latest component concept)

var router = sap.ui.core.UIComponent.getRouterFor(oController);
router.navTo("name_of_view", {}, false);

Display sapui5 yes-no popup dialog

var i18n = sap.ui.getCore().getModel('i18n');
var msg = i18n.getProperty('msg_defined_in_18nproperties_file');
jQuery.sap.require("sap.ui.commons.MessageBox");
sap.ui.commons.MessageBox.show(msg,
 sap.ui.commons.MessageBox.Icon.WARNING,i18n.getProperty('title_defined_in_18nproperties_file'),
 [sap.ui.commons.MessageBox.Action.YES, sap.ui.commons.MessageBox.Action.NO],
 function( sResult ){
     if(sResult == 'YES') { //... 
            }
        },
        [sap.ui.commons.MessageBox.Action.YES, sap.ui.commons.MessageBox.Action.NO]);

django-compressor on google app engine

Small tip: django-compressor requires that your static folder is readable by the application. This is configured in your app.yaml:

handlers:
- url: /static
  static_dir: static
  application_readable: True

Otherwise you'll get an empty manifest.json file, which means offline compressed files are not found.

Error loading MySQLdb module: No module named MySQLdb

sudo apt-get install python-mysqldb

Router vodafone

Para recuperar a password do router da vodafone...
Este truque funciona:

http://www.sereno.pt/?p=489

raspberry pi lcd links

Links with notes useful for an ongoing project:

https://learn.adafruit.com/adafruits-raspberry-pi-lesson-4-gpio-setup/test-and-configure
http://www.neighborgeek.net/2013/02/using-16x2-lcd-with-i2c-on-raspberry-pi.html
http://www.rpiblog.com/2012/07/interfacing-16x2-lcd-with-raspberry-pi.html
https://learn.adafruit.com/adafruit-16x2-character-lcd-plus-keypad-for-raspberry-pi/usage
http://www.extremeelectronics.co.uk/blog/i2c-control-of-lcd-display-using-ywrobot-lcm1602-v2-raspberry-pi/
http://nwazet.com/code/loading-i2c-spi-and-1-wire-drivers-on-the-raspberry-pi-under-raspbian-wheezy

Creating mysql development database

Quick & dirty way to create a localhost db for testing. Database is called db_dev and user is called db_dev_user

mysql -u root -p



mysql>CREATE SCHEMA db_dev;

Query OK, 1 row affected (0.01 sec)



mysql>CREATE USER 'db_dev_user'@'localhost' IDENTIFIED BY 'Passw0rd';

Query OK, 0 rows affected (0.01 sec)



mysql>GRANT ALL PRIVILEGES ON db_dev.* to 'db_dev_user'@'localhost';

Query OK, 0 rows affected (0.01 sec)



mysql>FLUSH PRIVILEGES;

Query OK, 0 rows affected (0.01 sec)



mysql>QUIT;

Bye

sap abap - get the day of week for a specific date

use fm : DAY_IN_WEEK Given a date, returns 01 if that date is monday, 02 for a tuesday, etc.

sap abap get number of days in a month

use fm NUMBER_OF_DAYS_PER_MONTH_GET

Automatically mount windows share on ubuntu linux

Create a file that will hold the user and password for the share. Make this file readable only by you.

nano ~/.raspcredentials

(type the following)

username=share_username
password=share_password

chmod 600 ~/.raspcredentials

Create the mount point for the share. I'll call it ~/docs but can be what you want

mkdir ~/docs

edit fstab as root. Here we will mount the /home of the share to the ~/docs folder.
Add this line to fstab

//ip_address_or_hostname/home /home/your_username/docs cifs credentials=/home/your_username/.raspcredentials,iocharset=utf8,sec=ntlm,uid=your_username,user,users 0 0

eg:

//192.168.1.3/home /home/tiago/docs cifs credentials=/home/tiago/.raspcredentials,iocharset=utf8,sec=ntlm,uid=tiago,user,users 0 0

At this moment you cannot yet mount it because samba/cifs is not yet installed. This is easy to fix:

sudo apt-get install cifs-utils

As non root, to be able to mount use mount <mount_point>. In this case this is

mount ~/docs

Done.

django-registration templates

Useful templates for django-registration 

http://devdoodles.wordpress.com/2009/02/16/user-authentication-with-django-registration/ 

https://bitbucket.org/devdoodles/registration_templates/src/3fa26711b93850ff40139dad7d741fb172d1c51b/registration/?at=default

Building a Raspberry Pi NAS - Part 1: Setting up file storage

This post is part of a series on building a low power, low cost NAS system based on a raspberry pi. Part 1 TO DO!

Building a Raspberry Pi NAS - Part 2: Sharing files on the network

This post is part of a series on building a low power, low cost NAS system based on a raspberry pi. On this post we share raspberry's files with the windows file sharing protocol (SMB) so that they can be accessed from any machine on the network, including windows. Installing Samba on the raspberry pi:

sudo apt-get update
sudo apt-get install samba samba-common-bin
(press Y)

editing samba config file:

sudo nano /etc/samba/smb.conf

Find line with wins "support = no" and change to "wins support = yes" In the end of the file paste the following definitions. We are sharing two volumes "home" and "media1". Home is smaller and files will be periodically backed up. media is larger but without redundancy.

[home]
   comment=Home
   path=/home/pi/mnt/home
   browseable=Yes
   writeable=Yes
   only guest=no
   create mask=0777
   directory mask=0777
   public=no

[media1]
   comment=media1
   path=/home/pi/mnt/media1
   browseable=Yes
   writeable=Yes
   only guest=no
   create mask=0777
   directory mask=0777
   public=no

Give a password for samba user pi

sudo smbpasswd -a pi

Building a Raspberry Pi NAS - Part 3: Storing files encrypted in the cloud

This post is part of a series on building the ultimate NAS system with a raspberry pi, creating your own "cloud".
In this post I'll present a way to make sure you do not lose your important files.
For this, we'll setup a personal account on a cloud service provider and then mount the space they give us on the raspberry pi's file system. The files will be replicated remotely to this service to prevent data loss if local file systems fail.
This storage space will also be used for very important and sensitive data. For this reason, it will be fully encrypted so that not even the cloud sys admins could read it.
Alternative titles:
- Mount box.com on raspberry pi
- Encrypt files with encFs on raspberry pi

Part 1: Getting a reliable remote storage space

First get an account on box.com (this is a cloud storage provider). Personal accounts are free and give you 10GB.  I chose them because they support the webdav protocol, unlike google drive which would be my first option. Other possible provider could be HiDrive
. In theory you could use any remote storage space provider that supports some protocol that you can use for mounting.
Now let's create a mount point. In this series I am mounting the different filesystems on ~/mnt. For this create a ~/mnt/box1 folder.

cd ~/mnt
mkdir box1

Now install the necessary packages to mount a webdav fs.

sudo apt-get install davfs2

We want this to be fully automated and automounted on reboot. For this, we need to store the user and password you used for the box.com account in a file.
Create folder ~/.davfs2

cd ~
mkdir .davfs2

Inside this folder, edit file called secrets

cd .davfs2
nano secrets

and insert a single line like this:

https://dav.box.com/dav username password

Where username / password are replaced by your own
Now we need to add the pi user to the davfs2 group so that he can mount these guys.

sudo usermod -aG davfs2 pi

Also do the reconfig:

sudo dpkg-reconfigure davfs2

Select yes on the screen that appears.
Edit /etc/fstab as root and insert the following line:

https://dav.box.com/dav /home/pi/mnt/box1  davfs  rw,noexec,noauto,user,async,_netdev,uid=pi,gid=pi  0  0

The _netdev specifies that this fs is only mounted if there is a network connection. You should test this. Logout and login again (so that your user gets the new group), and try to mount the file system with the following command:

mount /home/pi/mnt/box1

You will most likely get an error: /sbin/mount.davfs: file /home/pi/.davfs2/secrets has wrong permissions This is because the user pi is still not in the group above. Reboot the pi.

sudo shutdown -r now

Now that the pi is rebooted, go to the .davfs2 folder and change permissions of the secrets file. If you do not do it, you'll get the following error: "/sbin/mount.davfs: file /home/pi/.davfs2/secrets has wrong permissions"

cd ~/.davfs2
chmod 600 secrets

Now, try to mount the file system:

mount /home/pi/mnt/box1

if everything ok you can now copy files from/to /home/pi/mnt/box1 and they are being stored remotely.
Note: I have found that automounting this with the auto option in etc/fstab is not very reliable. For this reason, we'll use an init script below to deal with the auto mounting on boot.

Part 2: Encrypting the files

To encrypt the files we'll use EncFS. This is a filesystem that allows you to mount another existing mount point. When you create files on the EncFs file system, they are transparently encrypted with a password you have chosen and stored (encrypted) in the underlying file system. We'll use the file system created previously as the underlying storage.
Create a new mount point for the encrypted. I'll call it encbox1

cd ~/mnt
mkdir encbox1

Install encfs

sudo apt-get install encfs

To be able to mount fuse based file systems (like encfs) you need to be on the fuse group.

sudo gpasswd -a pi fuse

Now it is easy to create the encrypted virtual file system. Use the following command:

encfs ~/mnt/box1 ~/mnt/encbox1

This will use ~/mnt/box1 as an encrypted storage for whatever you create on encbox1.
Let's test by creating a file on encbox1 and then listing content of encbox1 and box1:

echo "test" > ~/mnt/encbox1/teste.txt
ls -lah ~/mnt/encbox1/
total 1,0K
drwxr-xr-x 3 pi pi 160 Abr 26 20:20 .
-rw-r--r-- 1 pi pi   5 Abr 26 20:11 teste.txt

ls -lah ~/mnt/box1/
total 2,5K
drwxr-xr-x 3 pi pi  160 Abr 26 20:20 .
-rw-r--r-- 1 pi pi 1,1K Abr 26 20:09 .encfs6.xml
drwx------ 2 pi pi    0 Abr 26 00:22 lost+found
-rw-r--r-- 1 pi pi   13 Abr 26 20:11 xbeDOz08kT4LmeJpXZmNAnky

Notice that the file is slightly larger after encryption (13Bytes) while the plain one is 5. This is because there is a overhead of +8Bytes when per file Initialization vectors are used. More with man encfs.

Part 3: Automounting encfs

As it turns out, automounting an encfs is not as simple as putting a line on /etc/fstab. We will create an init script for this and then set it to run automatically on boot. Create your script on /etc/init.d/boxencfs
Also, you need to put encfs password on a file only you can read.

cd ~
mkdir .encfs
cd .encfs
nano box1
(now insert your password and ctrl+o, ctrl+x)
chmod 700 box1

sudo nano /etc/init.d/boxencfs

And insert the following code:

#! /bin/bash
# /etc/init.d/boxencfs

### BEGIN INIT INFO
# Provides:          boxencfs
# Required-Start:    $remote_fs $syslog
# Required-Stop:     $remote_fs $syslog
# Default-Start:     2 3 4 5
# Default-Stop:      0 1 6
# Short-Description: Simple script to mount box.com via webdav and an encfs on top of it
# Description:       Mount box.com via webdav and encfs on top of it.
### END INIT INFO

# If you want a command to always run, put it here

# Carry out specific functions when asked to by the system
case "$1" in
  start)
    echo "Mounting box.com"
    su pi -c "mount /home/pi/mnt/box1"
    echo "Mounting encfs"
    su pi -c "cat /home/pi/.encfs/box1 | encfs -S /home/pi/mnt/box1 /home/pi/mnt/encbox1"
    ;;
  stop)
    echo "Unmounting encfs"
    su pi -c "fusermount -u /home/pi/mnt/encbox1"
    echo "Unmounting box.com"
    umount /home/pi/mnt/box1
    ;;
  *)
    echo "Usage: /etc/init.d/boxencfs {start|stop}"
    exit 1
    ;;
esac

exit 0

This script, when passed the start argument, first mounts the box1 system on /home/pi/mnt/box1 and then mounts the encfs. The password for the encfs is stored on /home/pi/.encfs/box1 ( a file created previously ) and then piped to the encfs. -S argument to encfs makes it read the password from stdin. With the stop argument it does the opposite in opposite order. After saving this file, make it executable:

sudo chmod +x /etc/init.d/boxencfs

Test this file very well by starting it and stopping it. A problem here may halt your reboot process. Test that it stops

sudo /etc/init.d/boxencfs stop

Now test that it starts. After this, check your encbox1 and box1 folders to see if they have the files expected.

sudo /etc/init.d/boxencfs start

When you feel this is fine, set it to run on boot/shutdown

sudo update-rc.d boxencfs defaults

And now reboot your pi and pray that it doesn't hang on reboot :)

sudo shutdown -r now

Part 4: schedule an rsync to copy files to box1

At this moment we have a folder with 10GB capacity and anything we put there is encrypted on the fly and sent to box.com servers. This folder will be where we will store a copy of our important files. To see this you can run df -h:

Filesystem               Size  Used Avail Use% Mounted on
rootfs                   7,1G  2,3G  4,5G  34% /
/dev/root                7,1G  2,3G  4,5G  34% /
devtmpfs                 211M     0  211M   0% /dev
tmpfs                     44M  416K   44M   1% /run
tmpfs                    5,0M     0  5,0M   0% /run/lock
tmpfs                     88M     0   88M   0% /run/shm
/dev/mmcblk0p1            56M   19M   38M  34% /boot
/dev/sda3                 12G  2,5G  8,5G  23% /home/pi/mnt/media1
/dev/sdb1                 30G  2,0G   26G   7% /home/pi/mnt/media2
/dev/sda2                9,8G  266M  9,0G   3% /home/pi/mnt/home
https://dav.box.com/dav   10G     0   10G   0% /home/pi/mnt/box1
encfs                     10G     0   10G   0% /home/pi/mnt/encbox1

In my case, I want to make a backup of /home/pi/mnt/home (which is a mount point for an external USB drive (see previous parts of this tutorial)) into /home/pi/mnt/encbox1. The command you want to run is:

cd ~/mnt
rsync -rtvuh --progress --delete home encbox1

This syncs whatever is in ~/mnt/home into ~/mnt/encbox1. -r means recursive, t to preserve modification times, v for verbose, h for human readable sizes. --delete makes files be deleted on encbox1 if they were deleted on home.

crontab -e

Now we setup cron so that this command is executed every day at 12:00. For this, type:

crontab -e

An editor appears, in my case it is nano. Insert a line like the following:

0 12 * * * rsync -rtvuhW --progress --delete --inplace /home/pi/mnt/home/ /home/pi/mnt/encbox1/ >> /home/pi/.log/boxbackups.log

This line has the following semantic: At minute 0 of hour 12, every day of the month, every month of the year, every day of the week. run the rsync command. The rsync flags are important. without --inplace, rsync creates all files with 0 bytes. This is a known issue when rsyncing to a network folder. Also, all paths are absolute, to avoid issues and the output is concatenated to a log file (/home/pi/.log/boxbackups.log) so that we can later see what was backed up.

References:
http://www.sbprojects.com/projects/raspberrypi/webdav.php
http://www.howtoforge.com/encrypt-your-data-with-encfs-debian-squeeze-ubuntu-11.10
http://www.jveweb.net/en/archives/2010/11/synchronizing-folders-with-rsync.html http://www.google.com :P

Backup raspberry pi sd card

Raspberry Pi's SD card can easily become corrupted which prevents pi booting. It has happened to me on a power failure. Best way to avoid this is to back it up. Assuming you have an usb drive mounted on /home/pi/mnt/home/ you can create a bzip2 archive of the sd card with :

sudo dd if=/dev/mmcblk0 | bzip2 > /home/pi/mnt/home/sdimage.bz2

This will take a lot of time. It will create a single file with the sd card image. Later, you can restore the image to the SDcard with the following:

sudo bzip2 -dc /home/pi/mnt/home/sdimage.bz2 | dd bs=1M of=/dev/mmcblk0
-d means decompress
-c means output to standard output

Another way to back it up via tar

tar -cvpzf backup.tar.gz --exclude=/backup.tar.gz --one-file-system / 

Restoring:

sudo tar -xvpzf /path/to/backup.tar.gz -C /media/whatever --numeric-owner