Grau DataSpace 2.2

I think it is time to write something about the current edition of GDS 2.2. A lot has been changed since my last post. Version 2.2 comes with a new design of the web UI. I think it is much easier to use than the first edition.

We removed the toolbar and moved the complete functionality into conext menues. A quota bar shows the available disk space.

An inline preview is created for many common file formats.

We added the possibility to define roles, global and private groups of users by a data space admin. Desktop sync clients are available for Windows, Linux and MacOSX. They are based on the CMIS protocol which gives us interoperability options with SharePoint, IBM Connections and major DMS systems.

The native clients for iOS and Android are also using the CMIS interface.

All our clients are released under an Open Source license to be able to modify them and adapt them to special requirements. The source is available on GitHub (http://github.com/opendataspace) 

GRAU DataSpace goes mobile with HTML5

The ownCloud gateway of GDS works well now with all existing clients (Android, iOS, desktop). The chunked upload feature took some time to implement as we had to implement a session management of our own to stay WebDAV compliant in the backend. Hope that the mirall client will support chunking in a compatible way.

The current development focus of the team are some admin APIs and admin frontends for the GDS. We are thinking of implementing a JSON based CLI aswell.

The CMIS gateway gets a reimplementation based on the JSON APIs of the backend. I hope to see more CMIS ready clients in the near future.

Mobile users might be interested in our upcoming Sencha Touch based mobile clients. The client works on all HTML5 enabled smart phones and tablets. We implemented a preview functionality for about 50 different file format. You can browse the content without downloading the file.

Here you get an impression of the HTML5 touch client:

First impressions of the new GDS2 webgui

Here you see the first screenshots of the new GUI of GDS2. It is based on extjs from (www.sencha.com) using the JSON API of the GDS.

GDS2 gets connected via OwnCloud Clients

The GDS2 gateway for ownCloud is making progress. We can connect the Android version of ownCloud sucessfully to our GDS2 backend. The client works well. OwnCloud uses WebDAV for all its operations. The initialization starts with a http-get request (http:///status.php) which gets filtered by our gateway before the WebDAV module gets connected. The gateway is a stand alone module and should work well with other WebDAV servers.

UPDATE (27.2.13): the iPhone client works also now. The XML parser obviously does not support name spaces. Perhaps one of the ownCloud developers knows why. We are fixing this problem in the gateway.

 The desktop clients connects as well. The content type problem was fixed in the GDS2 gateway. It was not necessary to patch any client.

 Now we will have to do some intensive tests to get ready for our demonstration at CeBIT. Visit us at booth F16 (214) in hall 6.

WebDAV Interoperability

Even the future of the WebDAV standard might be quite unclear it is still used be several hosters and cloud software stacks like ownCloud, SSP Data Space or GRAU DATA SPACE. Many clients have interoperability problems with some servers. Therefore I will test several clients with the new GDS2 and report about interoperability problems.

At first I checked the sever with the litmus interoperability suite. Here you see the results:

The GDS2 WebDAV implementation passed 12 of 16 test. Please let me know your experiences with your favourite WebDAV server. Current Windows clients (Win7) and MacOSX are reported to work without any problems.

I am a Linux user, so I will put my focus on Linux clients:

Nautilus

Nautilus (3.4.2 - gvfs 1.14) connects without any problem to the GDS2. There are obviously some problems with UTF-8 as the litmus test already told us:

Dolphin

Dolphin also connects without problems. It obviously has no problems with the UTF-8 implementation of GDS2 but it does not display the modification date of the files on the server:

Libre Office 4

The brand new libreoffce version 4 includes a webdav and a CMIS client implementation. Browsing the server worked as expected:

Storing an existing file works, creating a new one produces an error:

BBBJAM / GDS2 / WebDAV / ownCloud

Blackberry is back! Definitely! More than 1000 developers are joining the event. here in Amsterdam. I met George Staikos, the guy behind the most compliant browser on this planet. Gary Klassen,the inventor of the famous Blackberry Messenger (BBM), was joining the social event. We had a fruitful discussion on bringing more open source to the BB10 platform.

During the conference I got a new video from the developers of GRAU DATA SPACE 2 web GUI:

Nicolas Vivien helped us yesterday night to debug the current WebDAV implementation of GDS2. You can browse the GDS2 with PlayCloud now. Julian Reschke gave me a link to Litmus, a useful WebDAV compliance suite. Hope I can publish some results of several WebDAV compliance tests soon.

The developer of the ownCloud gateway reported that he is able to connect with the Android client successfully to the GDS2 backend.

New slide deck for GDS2 - Blackberry client

Over the weekend I prepared two new slide decks describing the new architecture of GDS2. You find them on slideshare:

• GRAU DATA SPACE 2 - english
• GRAU DATA SPACE 2 - german

I had some discussions with Nicolas Vivien. He is the guy behind PlayCloud, a cloud connected file manager for the Playbook and the BB10 platform. He supports already several cloud services.  GDS2 provides a JSON API for accessing the complete functionality of the backend. I hope he has the time to implement a GDS2 connector.

Another option is Ekkes app for BB10. It currently supports only the API of SSPs Secure Data Space. It it licensed under an Apache license. Hope we find someone who adds a JSON backend for GDS2.

We have a liftoff... and a video...

The implementation of the new GUI of the GDS2 has started! We are using extjs (www.sencha.com) on the client side, calling the GDS2 native JSON API on the server side. Hope you like our new layout:

On the right sight you see our preview pane. We will be able to display more than 50 different file formats.

Yesterday the guys from BoxCryptor fixed an interoperability issue in their clients. You will be able to encrypt your files before upload in the next release.

The owncloud interoperability gateway is making some progress also. 

The first release of GDS2 will be available at CeBIT in March.

UPDATE: Video says more than a picture...

Cloud attached GDS2

The new GDS2 architecture allows a distributed setup and an master/master replication between several locations.

Small companies might consider a cloud attached setup to get a certain level of redundancy of their data. Another reason might be to get better access performance and a higher security level via a centralized data center. The centralized instance might work as distribution hub for several distributed site. Deutsche Wolke offers this kind of services in the bunker data center of COMback.

UPDATE: After some brainstorming in Stuttgart last week, we are planning to shrink the footprint of the GDS2 core to fit into an ARM based appliance. The result will be a Data Space in a Box. The replication feature helps us to attach this box to the cloud or to other branch offices. Please contact me if you are interested in bundling the GDS2 with your hardware.

Distributed Data Space (GDS2)

The new core of the GRAU DATA SPACE (GDS2) is able to synchronize several distributed instances by master/master replication based on https. The versioning capability for each object guaranties that no data gets lots during the sync process.

A distributed data space might be interesting for organizations with several sites or partner companies who are interested in sharing data. Local desktop clients can be connected to the GDS2 by CIFS. Smaller sites do not have the need of an local windows file sever or NAS anymore. All other access methods (web, mobile, synced desktop) of the GDS will be available in this distributed setup as well.

Each object of the new GDS2 will have a minimum set of attributes which makes it possible to identify the object globaly:

• UUID of the object (RFC 4122)
• Hash (SHA-1)
• Creation time stamp
• Last modified time stamp
• UUID of the creator
• UUID of the user who did the last modification

With this minimal meta data set it should be possible to distribute the objects via CDNs. Further useful attributes might be:

• Origin URL (if the object comes from a website or file server)
• Geo location of creation (for photos)
• UUID of parent object (for folder structures)

GDS2 with FSA integration

GRAU DATA developed a software called file server archiver (FSA). The FSA automatically analyzes data from files servers according to predefined parameters. Inactive and/or seldom-used files are then automatically transferred to any desired NAS storage or archive system or object stores. The user can access the relocated data whenever desired. FSA software completes the concept of hierarchical storage management in heterogeneous networks.

With the new architecture we will integrate the FSA functionality with GDS2. The user will be able to view/access/recall all files which are replicated from a file server to the object store in the web gui of GDS2. The integration between FSA and the core of GDS2 will be achieved by an ESB which get a message when the FSA has written an object to the object store. GDS2 will update the meta data and handle the file like an internal object. The user now can decide whether the object will be restored on the original file server location or he can access it through the GDS2 clients (web, desktop, mobile).

With this solution we will be to eliminate the need of a file server backup. The user can access multiple versions of the original file. The costs for the backup infrastructure will be reduced (software and administration).

GDS2 (GRAU DATA SPACE 2)

GRAU DATA is working on a next generation data space product which will provide a lot of new features:

• more interactive web gui based on extjs
• focus on CMIS 1.1, including JSON API
• more scalability by separating metadata from (file) objects
• adding more backend storage options (object store, relational data bases, CIFS)
• fulltext search
• versioning
• server to server replication

The new architecture will look like this:

 
GRAU also thinks about an interoperability gateway for ownCloud clients. OwnCloud uses a WebDAV based portocol (with a simple extension at connect time) which should be quite easy to support.

GRAU DATA has opened a new group on Facebook to stay in contact with the user community. Feel free to join! (www.facebook.com/groups/graudata)

Open Data Space for Blackberry (Preview)

For all developers who are interested in one of the first applications which leverages the new Cascades UI of BB10 we are providing a preview of the Open Data Space for Blackberry, developed by Ekkehard Gentz.

If you own a DevAlpha device, you can download the app in the AppWorld from here.

A short screencast of the user interface is available from here.

The source code (Apache v2) is forkable from here.

Open Data Space is comming...

In my last post I gave an introduction to the joint development of a filesharing platform for the enterprise powered by SSP Europe and GRAU DATA AG. Today I would like to announce that the core technology will be available under an open source license.

We will start with the mobile clients. The first client which will be available under the Apache License v2 is the brand new client for BB10, which is developed by Ekkehard Gentz. The repository at github was already created by RIM: opendataspace. Ekke will checkin some code soon. Please follow him on twitter.

The other clients for iOS and Android will follow under the same lincense (ASLv2). Developers will have the possibility to integrate parts of the Open Data Space (ODS) client into their software or improve the existing ones.

For the server side we made the decision that we will license a core version under the APGv3. This will allow open source and proprietary extensions to the core framework. The architecture of the ODS will look like:

The architecure will be modular and extensible on the backend and on the frontend through plugins. The sever side is written in Java, the clients are written in Objevtive-C (iOS), Java (Android) and QML/C++ (BB10).

You can follow the development on twitter or discuss your wishes and give some feedback in our Facebook group.

The JSON API for mobile devices is already fully documented. You can download the documentation in our Facebook group.

UPDATE: agorum joint the open data space project. We will get a lot of open source based functionality like:

• versioning
• transactional database backends
• fulltext search
• CMIS (atom pub)
• WebDAV
• master/master replication
• JSON API for all backend functionality

We plan to include a interoperability gateway based on WebDAV for connecting other clients like owncloud. So you will have freedom of choice. Further partners are welcome!

Secure Filesharing in the Cloud

Filesharing in the cloud is nothing new. Many people are already using DropBox or other services to synchronize their files between several devices or to share them with other people. On the other side big companies like IBM are banning these sevices because of security concerns (Technology Review).

So what to do if you are a small company or an individual who needs this kind of services? Fortunately, there are alternatives to DropBox and iCloud available, which can be installed on premise or at a secure place.

One of these is the a solution called DATA SPACE which has become a joint venture between SSP-Europe and GRAU DATA. These companies have joint forces to provide a Java based, enterprise class solution for sharing files inside larger organizations, partners and individuals.

Today the solution is already deployed at several customers, one of them is Orange Austria (Orange Data Space). GRAU DATA is offering the software as GRAU DATA SPACE for enterprise customers.

The DATA SPACE solutions offers a WebGUI and mobile native clients for Android, iPhones, iPads. A Blackberry version for OS7 and BB10 is under development. A DATA SPACE offers the possibility to define data rooms where users can share their files. Administrators can define sub rooms which can be assigned individually.

The files can also be accessed via WebDAV from any desktop operating system. Currently a CMIS interface is under development which is also used for the desktop sync clients for Windows, MacOSX and Ubuntu.

All files are stored on an encrypted file system. Optionally, all files can be encrypted individually during the upload by keys which are stored in a HSM (hardware security module). The solution will get a data privacy certifcation from the ULD.

FreeRDP becomes cloudy

As I mentioned in some of my former posts, the FreeRDP project makes progress in becomming a platform for cloud based desktop services.

Fritz Elfert started a project called FreeRDP WebConnect. The project provides a gateway which allows a JavaScript based browser client to connect to a RDP server. The connection between the client and the gateway is based on websockets.

The JavaScript client implements a virtual keyboard for the RIM playbook.

Click here, to connect your browser to a Windows 2008 server.

UPDATE: The FreeRDP project (powered by ThinStuff) published a Android and an iOS version in the app stores. Here you get the details.

RIM is back and moving to Open Source

Last weekend I bought a RIM PlayBook at Mediamarkt for only 189,00€ to get some an impression of the new Blackberry OS. The kernel is bases on QNX a realtime, POSIX compliant operating system, which is based on a microkernel architecture (yes Microsoft, POSIX has won: Linux, MacOS, QNX, ...). QNX is very robust and used in a lot of different industrial realtime environments and CISCOs high availibility edition of IOS. QNX was aquired by RIM some in 2010, the source code is available, but not under an open source license (yet).

RIM obiously morphes to an open source friendly company. They started several projects on github and hired an open source veteran Eduardo Pelegi-Llopart. He was responsible for several open source projects at Sun like Glasfish and is member of the advisory board of CloudBees, the new company of Sacha Labourey. I hope to see him next week after visiting the OSBC 2012 (www.osbc.com) in SFO.

Back to the PlayBook impressions. I think the new RIM tablet os is an intersting alternative to Apple platform if you need a secure platform which is based on industrie standards. RIM supports Flash, Adobe AIR, HTML5, Qt and QML, JavaScript, and a new UI framework called Cascades (Video). The funny thing about that is, that RIMs leverages NOKIAs investments in Qt. Games like Angry Birds and Cut the Rope are alreay available, the Unity enginge will be supported soon. I hope to see official Mono support from my friends at Xamarin aswell.

Android-x86 - the Linux Desktop for the Masses

Some moths ago I ordered the cheapest Asus EeePC, the X101. It has no LAN port and no hard disk. It came preinstalled with the dead Meego OS. I replaced it with Ubuntu successfully.

Two weeks ago I decided to replace Ubuntu with the release candidate of Android-x86. It works out of the box on most Asus netbooks.

The performance of my Xoom tablet feels slower than Android-x86 on the X101. Android-x86 is based on Android 4 and comes with most of the standard Android apps (mail, calendar, music player).

Some further apps are easy to install from GooglePlay (the former Google market):

• DropBox
• Radio.de
• IM+ (commercial instant messenger)
• Google Reader
• Google Maps
• Tagesschau
• Audible
• Kindle reader

The most apps are working. Some of the are starting with rotated screen, which makes the useless. Some others are not listed in GooglePlay. The Kindle app has problems when you try to turn over a page. Native keyboards are obviously not supported yet. Switching to a German layout did not work for me.

The overall impression of Android-x86 is a very good option for netbooks in my opinion. I think it will bring Linux finally to the masses!

Next generation SANs

If you are looking for an affordable SAN storage which allows you to get best performance and different fabric modules you should have a look at RisingTide Systems.

RTS offers SAN storage based in LIO (www.linux-iscsi.org). The target and most fabric modules are upstream in the Linux kernel now. There are modules for iSCSI, Fibre Channel, FCoE and Infiniband (SRP) available. The system is managed by a CLI tool called RTSadmin.

LIO offers support for different backends like block level devices, filesystems, RAM-disks or plain SCSI devices. If you have enough money you can also use a flash card from FusionIO to get a ultra high speed storage server. A prototype was demonstrated last year at Interop.

Future versions will fully integrate with DRBD and the new thin provisioning target for device mapper. With these features you will get many enterprise storage features.

RTS offers also an iSCSI initiator which allows multiple TCP connections within a iSCSI session. This allows an efficient multipathing and loadbalancing. The default initiator of Linux does not support multipathing on iSCSI level. The Windows iSCSI initiator supports this features too.

The latest version of the RTS target also support the VAAI extensions for VMware.

JavaScript, the Lingua Franca of the Internet

The performance of JavaScript is getting better and better. I think this will help to get rid of traditional operating systems in the near future.

There are several demos available where you can see the power of JavaScript:

• Linux running in a x86 emulator 
• PDF viewer
• H.264 decoder
• MP3 decode
• SIP client 
• UNIX shell

Fritz Elfert will try to develop a RemoteFX decoder in JavaScript for the Open Thin Client Alliance together with the FreeRDP project, sponsored by BaWue goes mobile. The goal is an Open Source RDP client, which implements as many features as possible in a browser.

UPDATE: Telefonica announced a new device which focuses totaly on HTML5, called OpenWebDevice. Qualcomm will deliver the silicon, Mozilla delivers the boot2gecko enginge. Is this the first real Andoid killer?

UPDATE: Scripting languages are getting nearly as fast as C++. A canadian company called Fabric Engine provides a ultrafast JavaScript and Python implementation. The engine can be licensed under AGPL and a commerical license. It supports multithreading an can be used for Python and JavaScript. Here are some benchmarks.

UPDATE: Here is the first screencast of a JavaScript webgateway for FreeRDP: http://goo.gl/hFaib. The source code will be released on LinuxTag 2012.

UPDATE: Here it comes: a audio and video SIP client written in JavaScript. I think the time of a classic Windows PC is finally over.

UPDATE: Here you find a UNIX shell written in JavaScript.