IT Brief New Zealand logo
Technology news for New Zealand's largest enterprises
Story image

Sony’s 3D Creator brings 3D scanning to the masses

By Darren Price
Fri 24 Nov 2017
FYI, this story is more than a year old

It takes a lot for me to get excited about a mobile phone, but Sony Mobile managed to do exactly that at a demonstration of their new 3D scanning technology. With the roll-out of Android 8.0 Oreo, starting with the Xperia XZ Premium and the new Xperia XZ1 in New Zealand, Sony has launched its 3D Creator software enabling, users use their phones to easily capture faces and objects in 3D.

I love 3D, Sony loves 3D and you should love 3D. Our world is 3D, but due to technical limitations, up until very recently, we, as consumers, have been limited to sharing our lives in 2D only.

That’s going all going to change.

3D objects

3D movies allow us to peer into a filmmaker’s 3D world and virtual reality enables us to totally immerse ourselves in a software developer’s 3D environment. The next stage is empowering individuals to create their own 3D content.

Imagine recording your memories, family portrait photos, your wedding cake, your sleeping dog and even your lunch in 3D, and then, if you wish, sharing them with your friends on social media.  

Sure, 3D scanning has been around for a while, but it’s involved expensive scanning equipment, or taking hundreds of photos and waiting for a complex program or a cloud service to process them into a 3D model. So, when Sony Mobile in Sydney showed me one of their Xperia XZ Premium phones scanning objects, faces and heads, real-time in 3D, I was a bit gobsmacked.

Darren's head

The idea is simple enough, if you take enough photos you can use 3D photogrammetry software like RealityCapture and PhotoScan to create 3D models of your subject. Anyone that’s done this will know that in practise it's laborious and fraught with difficulties. You are talking a few hours to get from your photos into a something like SteamVR’s Destinations for viewing in virtual reality on the HTC Vive.

Without sounding like a Sony Mobile plant, this new update to the Xperia XZ Premium and XZ1 puts all the hard work when creating 3D scans into a Sony mobile phone. Sony’s 3D Creator enables users of Xperia XZ Premium and XZ1, updated to Android 8.0 Oreo, to 3D scan objects in minutes. The software comes with helpful wizards individually designed for face scans, head scans and food (!?!) scans. Once you are a pro, you can start using the freeform scan option to scan anything. I’m advised that, for the moment, the technology is limited to something the size of medium-sized dog.

Two things to be mindful about when scanning. The first is to ensure that you are in a bright, evenly-lit area. Shadowy subjects don’t scan well and the Xperia will tell you off if you attempt and to do so. Secondly, when under pressure to carefully scan your subject, be mindful that the Xperia’s sleek glass exterior becomes very slippery in clammy hands. I was very fearful of losing my grip on the phone and having it shatter into a million pieces on the stone floor.

editing

The 3D Creator software does it’s best to guide you through the scanning process, but it still takes a bit of practise. Basically, all you need to do in order to make a 3D scan is carefully move the phone’s camera around your subject, following some handy on-screen guides. You then sculpt in some of the detail that the initial scan may have missed and them click done. In moments, and I really mean moments, you are presented with a 3D scan of your subject which you can rotate and zoom on the screen.

But then what do you do with it?

From the 3D Creator application, you can print your scan using 3D printer. Fancy treating your family to a miniature bust of your head for Christmas? Now you can.

3D Scan

You can impress your friends by creating your own inch-high 3D avatars. 3D Creator comes with its own augmented reality app that enables you to project tiny customised avatars based you your head scans onto your desk, your table or anything else around you. I found it a little fiddly – accidentally pressing buttons on the phone – and, like most AR, it’s a bit gimmicky, but OK for a giggle.

The 3D Creator app also allows you to set your model as a live wallpaper on your phone or just share it as a file. The software can output to Wavefront .obj files that can be imported into most industry 3D applications. Alternatively, you can upload your scanned model to popular 3D site, Sketchfab and view it there, or within the Sketchfab VR app.

3D application

At the Sony Mobile demonstration at their Sydney HQ, I was shown scans created with 3D Creator exported into free 3rd party app, Shadow Avatar, from Uraniom. This app can take your scanned head and place it on the shoulders of a 3D avatar. You can then choice from a number of options, whereby “you” get to dance around or insert yourself in scenes in the style of Star Wars and even the Blade Runner 2029 movie trailer. You can then export these as mpeg files to keep or share.   

This is, of course just the beginning of a new way for people to interact, create and share 3D content with one another.

The obvious application for Sony’s 3D scanning technology is taking 3D photos, archiving and preserving memories. It won’t be long before people start posting 3D scans of their lunch on social media for friends to pan and zoom around. Thankfully the scanning process is so quick, avoiding food getting to cold whilst capturing it in 3D.

Cake

Of course, thinking outside the box, the ability to recreate objects and things, easily in 3D, opens up all sorts of opportunities.

One of the most amazing things that I have ever done in virtual reality was to model a spaceship that I drew as an eight-year old in 3D and inject it into VR. Using my HTC Vive VR set-up I could stand and look up at the huge spaceship and take a walk across the top of its hull.

Scale is nothing in virtual space. Imagine making a scan of the pet dog sleeping, a favourite ornament, a bowl of cornflakes or even Granma’s head, and making it ten-metres high so you can stand next to it and look up and admire it in it’s full VR glory. If you’ve got an HTC Vive VR set-up you can do that right now. I’d imagine it won’t be long before you can view your 3D Creator models using Sony’s own PlayStation VR kit.  

More serious applications future could be in aiding medical examinations, criminal investigations and archaeology. Imagine a palaeontologist being able to scan a fossil, in-situ, for study later or a sculptor recording the iterations of their work.

Xperia XZ Premium   

But, what about the Sony Xperia XZ Premium phone itself? I’m not much of a phone guy, but I can’t help but be impressed by a phone with a 5.5-inch screen with the same spec as my new TV. The Xperia XZ Premium is the world’s first 4K HDR phone using the same Sony Bravia technology as Sony TVs.

Practically speaking, watching the 4K stream of Marvel’s Punisher via Netflix with that sort of pixel density is pretty amazing. Of course, the general clarity of the screen for day-to-day use is also fantastic. Opening something like a large spreadsheet, you can actually still see the data without having to zoom right in and pan around.

Halo

The Xperia XZ Premium also features a mind-blowing Motion Eye camera capable of recording 960 frames-per-second in 720p. By slowing down the video can capture fast moving object in crisp, blur-free detail. For regular frame-rates you are still able to capture video at 4K! On a phone!

If you are a PlayStation 4 owner to can use your Xperia as a screen to play anywhere in your house via Remote Play. The phone’s 4K screen gives you an uncompromising alternative display for your game.

All this is made possible by the ARM-based Qualcomm Snapdragon 835 chip, which won’t make your 7th Gen Intel CPU worried, but in terms of mobile devices, it’s a powerhouse. In comparison, it offers roughly a third of the performance of an Intel i7 7700K equipped PC with a Geforce GTX1050- which isn’t bad considering it can fit the phone in your pocket.

Xperia XZ1

The Sony Xperia XZ1 features the same Snapdragon 835, CPU Adrono 540 GPU, 19MP and 1/2.3" Sony IMX400 camera as the Xperia XZ Premium. The only compromise is that it has a 1080p HDR display rather than the 4K HDR screen.

Sony Mobile has really hit the ball out of the park. Not only is the Xperia XZ Premium an amazing phone, the addition of 3D Creator gives it a killer app.

The ability to scan objects in 3D so easily from your mobile phone is a game changer. We can all look forward to world full of user-created 3D content in the months ahead as this fantastic technology develops.

Related stories
Top stories
Story image
Wireless
Cradlepoint expands its Cellular Intelligence capabilities
Cradlepoint has announced additional Cellular Intelligence capabilities with its NetCloud service.
Story image
Customer experience
Research unveils precarious customer loyalty for retailers
New research has found customers are reassessing established brand loyalties as their priorities and behaviours shift.
Story image
Cybersecurity
NCSC advisory highlights poor security configurations
The GCSB's National Cyber Security Centre (NCSC) has released a cyber security advisory identifying commonly exploited controls and practices.
Story image
Digital Transformation
Trading up: It's time to swap core systems for flexible digital applications
This year will see more oranisations planning and commencing high tech renovations that will shake up the way they operate.
Story image
Ivanti
Ivanti and Lookout bring zero trust security to hybrid work
Ivanti and Lookout have joined forces to help organisations accelerate cloud adoption and mature their zero trust security posture in the everywhere workplace.
Story image
Commerce Commission
ComCom welcomes new marketing codes for the telecom industry
The Commerce Commission is welcoming the creation of new marketing codes for the telecommunications industry.
Story image
Safety
Voxel hits total funding of $18M following ongoing wins
Since raising its seed round in September, Voxel has grown at pace, by decreasing on-site injuries by upwards of 80% and increasing operational productivity.
Story image
Digital Transformation
How to modernise legacy apps without compromising security
At a time when digital transformation has become central to business, even the most important applications come with a ‘use-by’ date.
Story image
Workato
Workato unveils enhancements to enterprise automation platform
"The extra layer of protection with EKM, zero-logging, and hourly key rotation gives customers a lot more visibility and control over more sensitive data."
Booster
Booster Innovation Fund. A fund of Kiwi ingenuity – for Kiwi investors.
Link image
Darktrace
Threat actors are exploiting weaknesses in interconnected IT/OT ecosystems. Darktrace illuminates your entire business and takes targeted action to stop emerging attacks.
Link image
Story image
Artificial Intelligence
CFOs using digital workers and AI to prevent unnecessary loss
New technology is now allowing CFOs to use digital workers to automate their accounting processes, making it easier for them to avoid unnecessary losses.
Story image
Application Security
What are the DDoS attack trend predictions for 2022?
Mitigation and recovery are vital to ensuring brand reputation remains solid in the face of a Distributed Denial of Service (DDoS) attack and that business growth and innovation can continue.
Story image
Fonterra
Fonterra to use automated guided vehicles by Dematic
New Zealand's dairy giant Fonterra is upgrading its manufacturing facility in Edendale with new automated guided vehicles (AGVs) from Dematic.
Story image
Cybersecurity
The 'A-B-C' of effective application security
Software applications have been a key tool for businesses for decades, but the way they are designed and operated has changed during the past few years.
Story image
Remote Working
IT teams deploy powerful technologies to enable remote work
"We found that IT teams mastered the challenges of remote work last year in large part by employing powerful yet easy-to-use technologies."
Story image
Sustainability
Grasping the opportunity to rethink the metrics of a sustainable data centre
A data centre traditionally has two distinct operations teams: the Facility Operations team, and the IT Operations team. Collaboration between them is the key to defining, measuring, and delivering long-term efficiency and sustainability improvements.
Story image
Talend
Talend introduces new data health solutions for businesses
Talend has announced its latest version of Talend Data Fabric, with the release of Talend Trust Score enabling data teams to establish a foundation for data health.
Softiron
For every 10PB of storage run on HyperDrive vs. comparable alternatives, an estimated 6,656 tonnes of CO₂ are saved by reduced energy consumption alone over its lifespan. That’s the equivalent of taking nearly 1,500 cars off the road for a year.
Link image
Story image
Sisense
Data and analytics could be key to higher selling prices in APAC
Sisense's latest report has found that almost half of data professionals in APAC think customised data and analytics can create better selling prices for their products.
Story image
Sift
Sift shares crucial advice for preventing serious ATO breaches
Are you or your business struggling with Account Takeover Fraud (ATO)? One of the latest ebooks from Sift can provide readers with the tools and expertise to help launch them into the new era of account security.
Story image
Ransomware
A third of companies paying ransom don’t recover data - report
Veeam's report finds 76% of businesses who are victims of cyberattacks paid the ransom to recover data, but a third were still unable to get their information back.
Story image
Ransomware
Cybersecurity starts with education
In 2021, 80% of Australian organisations responding to the Sophos State of Ransomware study reported being hit by ransomware. 
Story image
Adyen
Adyen expands partnership with Afterpay as BNPL payments increase
Adyen has expanded its partnership with AfterPay allowing more of Adyen’s merchants in more countries worldwide to use the BNPL provider.
Story image
Apple
Apple previews new features for users with disabilities
Apple says new software features that offer users with disabilities new tools for navigation, health and communication, are set to come out later this year.
Story image
Hawaiki Cable
BW Digital completes acquisition of Hawaiki Submarine Cable
BW Digital has completed its full acquisition of Hawaiki Submarine Cable, with all applicable regulatory filings and approvals now received.
Story image
SaaS
Cloudflare launches instant serverless database for dev teams
"Today we’re announcing our first serverless database which we expect will quickly become one of the largest databases in the world."
Story image
Remote Working
How zero trust and SD-WANs can support productive remote working
The way people connect with applications and data has changed, users are remotely accessing resources that could be stored anywhere from a corporate data center to the cloud.
Story image
Cybersecurity
A10 Networks finds over 15 million DDoS weapons in 2021
A10 Networks notes that in the 2H 2021 reporting period, its security research team tracked more than 15.4 million Distributed Denial-of-Service (DDoS) weapons.
Story image
Sustainability
Power at the edge: the role of data centers in sustainability
The Singaporean moratorium on new data center projects was recently lifted, with one of the conditions being an increased focus on power efficiency and sustainability.
Story image
Artificial Intelligence
How to ensure ethical deployment of AI implentations
The increase in automation and machine technology such as AI and machine learning has unlocked a whole new level of scale and service to organisations. 
Story image
Excel
Could your Excel practices be harming your business?
While Excel has been the de-facto standard for budgeting, planning, and forecasting, is it alone, enough to support organisations in the global marketplace that’s facing rapid changes due to digital transformation?
Story image
Fortinet
Fortinet's Security Fabric hits new record for integrations
The Fortinet Security Fabric has surpassed 500 technology integrations with more than 300 Fabric-Ready Technology Alliance Partners.
Story image
Sustainability
Siemens showcases new automated solutions for data centers
Siemens has implemented new automated solutions and AI in the Baltic region's largest data center, providing insight into the future of data center management.
Story image
Data Center
Preventing downtime costs and damage with Distributed Infrastructure Management
Distributed Infrastructure Management (DIM) can often be a lifeline for many enterprises that work with highly critical ICT infrastructure and power sources.
Story image
BeyondTrust
BeyondTrust integrates Password Safe solution with SailPoint
BeyondTrust has announced the integration of BeyondTrust Password Safe with SailPoint identity security offerings.
Exabeam
Find out how a behavioural analytics-driven approach can transform security operations with the new Exabeam commissioned Forrester study.
Link image
Story image
Lightspeed
Lightspeed launches all-in-one marketing platform in A/NZ
ECommerce provider, Lightspeed has launched a new all-in-one marketing solution, Lightspeed Marketing & Loyalty in Australia and New Zealand.
Story image
CRM
Zendesk announces new conversational CRM solutions
“The last few years have made it obvious that digital is the front door, convenience is paramount and relationships are anchored in conversations."
Story image
Microsoft
PwC NZ unveils new Cloud Security Operations Center
PwC New Zealand has unveiled its new Cloud Security Operations Center for the entire Microsoft technology stack.
Story image
Artificial Intelligence
SAS unveils AI experience to improve kids' batting abilities
SAS has created The Batting Lab, an interactive experience using AI, computer vision and IoT analytics to help kids improve their baseball and softball swings.
Story image
Artificial Intelligence
Clear Dynamics closes $35M funding round, invests in global growth
The funding is a major milestone and speaks to Clear Dynamics’ vision for AI-enabled ‘composable’ enterprise software, the company states.
Story image
Commerce Commission
ComCom appeals $2.25 million fine in Vodafone FibreX case
The Commerce Commission has filed an appeal in the High Court against a $2.25 million fine imposed on Vodafone NZ for its offending under the Fair Trading Act.
Story image
Cybersecurity
Managed service providers: effective scoping to avoid costly vendor pitfalls
Managed security services are outsourced services focusing on the security and resilience of business networks.