Archive for the ‘augmentedreality’ Category

Updated Beyond Reality Face to v2.2.0

Hello everbody!

Today we want to introduce Beyond Reality Face v2.2.0 to you. This update solves some issues we had with the whole structure of the SDK. Now it’s an All-In-One package including all known features:
+ Point Tracking: Follow a certain point over a playing video/webcam stream.
+ Face Detection: Find faces in images or webcam streams.
+ Face Shape Estimation: Analyse found faces and estimate their features (eg. eyes, lips, brows)
+ 3D Pose Estimation: Get the 3D position/rotation out of the analysed face shape.

We also added more example code:
+ Flash Player 11/Stage3D container for Flare3D v2.0 – example app:
+ Shape Mask exporter/viewer – example app:
+ Point Tracking – example app:

By the way: The FP11 example comes with occlusion. It’s an ‘invisible’ head hiding all things (we want) behind it (eg. good to hide for bows of glasses).
Use your own FP11 compiling settings in your IDE (eg. in FDT) to start the FP11 example. The current setting is Flex 4.1 for FP10.1. We change that to Flex 4.5.1, when we compile to FP11.

If you have any questions or hints, please comment on Facebook:

You can get the new SDK here:


Halloween fun apps using BRF

Just to direct you to a nice Beyond Reality Face (BRF) Halloween fun!

Sweden based agency Stopp created a nice little Halloween app using BRF + 3D overlays. Create an image and use it as your creepy profile image:

Tomek and me made a small Halloween app using BRF + face substitution like overlay. Take a snapshot and upload it to Facebook + use it as profile image:

If you want to do a Christmas special using BRF, contact me via:

I hope to find the time to make another blog post about the tech in PhotoBoo, since it was requested alot.

Thanks for reading!

At Flash on the Beach 2011 in September I had the  honour to do a 3 minutes session at the Elevator Pitches.
Here is the demo I put together:

Beyond Reality Face – Face Recognition/Tracking in Flash

I was really lazy here. There happened alot since November 2010. The biggest and coolest thing was the development of our face tracking and Augmented Reality SDK ‘Beyond Reality Face’ v2.0 for Flash/Actionscript 3.

In December 2010 we had ‘LISA’, a nice, but not very user friendly approach of face tracking. You had to fit yourself into a given mask, hold this position and click ‘start’. One wipe of your hand in front of your face or rotating your head too much resulted into a loss of tracking. The reset algorithm was good, but the tracking was not robust enough.

So we decided to look for a better approach, something smart, which starts right away, no clicking, no fitting into a mask and more robust. Two days before Christmas we started the development of an ‘Active Shape Model’ algorithm. We invested all the time we could afford beside our daily projects and finished the development on 20th of April 2011.

It was really hard to get a decent FPS. But thanks to Joa’s Apparat we optimized the hell out of this algorithm and got it from 30 seconds down to 30 to 40 ms. Hell yeah, That was heavy shit!

So what’s inside of the SDK? We offer you 2 (3) versions.

The actual ‘Beyond Reality Face’, coming with
face recognition – finding the rough position of a face in an image
face estimation – finding the actual face shape/features
pose estimation – calculating the 3D head pose of a found face shape.

‘BRF Face Estimation’
This is the face estimation part, no recognition, no pose estimation.

‘BRF Point Tracking’
This algorithm was used in ‘LISA’, our first face tracking approach.

All downloadable trial versions come with documation and examples. The big SDK has classes to show the usage for:
single user image + 2D image of an object
single user image + 3D model of an object
face recognition + face estimation
face recognition only
webcam stream + 2D image of an object
webcam stream + 3D model of an object

Our showcase app shows you the last option:

For other than personal/private use contact us via

What are the next steps?

Currently we are preparing a small bunch of Molehill (Stage3D) demos. We are just waiting for Flare3D to launch the next version of their 3D engine.

If you have any questions about BRF or if something is missing in the SDK, just drop me a line. I would love to see your experiments with the SDK.

Thanks for reading.