arcore

by Ayusch Jain

通過Ayusch Jain

如何使用ARCore和Android Studio構(gòu)建增強(qiáng)現(xiàn)實(shí)Android應(yīng)用 (How to build an Augmented Reality Android App with ARCore and Android Studio)

This article was originally posted here

本文最初發(fā)布在這里

In the previous post, I explained what ARCore is and how it helps developers build awesome augmented reality apps without the need to understand OpenGL or Matrix maths.

在上 一篇 文章中 ，我解釋了ARCore是什么以及它如何幫助開發(fā)人員構(gòu)建超棒的增強(qiáng)現(xiàn)實(shí)應(yīng)用程序，而無需了解OpenGL或Matrix數(shù)學(xué)。

If you haven’t checked it out yet, I highly recommend doing so before moving ahead with this article and diving into ARCore app development.

如果您還沒有檢查過，我強(qiáng)烈建議您這樣做，然后再繼續(xù)本文并深入研究ARCore應(yīng)用程序開發(fā)。

總覽 (Overview)

According to Wikipedia, ARCore is a software development kit developed by Google that allows for augmented reality applications to be built.

根據(jù)Wikipedia的說法 ，ARCore是Google開發(fā)的軟件開發(fā)套件，可用于構(gòu)建增強(qiáng)現(xiàn)實(shí)應(yīng)用程序。

ARCore uses three key technologies to integrate virtual content with the real environment:

ARCore使用三種關(guān)鍵技術(shù)將虛擬內(nèi)容與實(shí)際環(huán)境集成在一起：

Motion Tracking: it allows the phone to understand its position relative to the world.

運(yùn)動(dòng)追蹤：它可以讓手機(jī)了解其相對(duì)于世界的位置。

Environmental understanding: This allows the phone to detect the size and location of all type of surfaces, vertical, horizontal and angled.

對(duì)環(huán)境的了解：這使手機(jī)可以檢測(cè)所有類型的表面(垂直，水平和傾斜)的大小和位置。

Light Estimation: it allows the phone to estimate the environment’s current lighting conditions.

燈光估計(jì)：它使手機(jī)可以估計(jì)環(huán)境當(dāng)前的照明條件。

入門 (Getting Started)

To get started with ARCore app development, you first need to enable ARCore in your project. This is simple as we will be using Android Studio and Sceneform SDK. There are two major operations Sceneform performs automatically:

要開始進(jìn)行ARCore應(yīng)用程序開發(fā)，您首先需要在項(xiàng)目中啟用ARCore。 這很簡單，因?yàn)槲覀儗⑹褂肁ndroid Studio和Sceneform SDK。 Sceneform自動(dòng)執(zhí)行兩個(gè)主要操作：

Checking for availability of ARCore

檢查ARCore的可用性

Asking for camera permission

要求相機(jī)許可

You don’t need to bother with these two steps when creating an ARCore app using Sceneform SDK. But you do need to include Sceneform SDK in your project.

使用Sceneform SDK創(chuàng)建ARCore應(yīng)用時(shí)，您無需費(fèi)心這兩個(gè)步驟。 但是您確實(shí)需要在項(xiàng)目中包含Sceneform SDK。

Create a new Android Studio project and select an empty activity.

創(chuàng)建一個(gè)新的Android Studio項(xiàng)目并選擇一個(gè)空的活動(dòng)。

Add the following dependency to your project level build.gradle file:

將以下依賴項(xiàng)添加到項(xiàng)目級(jí)別的build.gradle文件中：

dependencies { classpath 'com.google.ar.sceneform:plugin:1.5.0'}

Add the following to your app level build.gradle file:

將以下內(nèi)容添加到您的應(yīng)用程序級(jí)別build.gradle文件中：

implementation "com.google.ar.sceneform.ux:sceneform-ux:1.5.0"

Now sync project with Gradle files and wait for the build to finish. This will install the Sceneform SDK to the project and Sceneform plugin to AndroidStudio. It will help you to view the .sfb files. These files are the 3D models which are rendered in your camera. It also helps you in importing, viewing, and building 3D assets.

現(xiàn)在，將項(xiàng)目與Gradle文件同步，并等待構(gòu)建完成。 這會(huì)將Sceneform SDK安裝到項(xiàng)目中，并將Sceneform插件安裝到AndroidStudio中 。 它將幫助您查看。 sfb文件。 這些文件是在相機(jī)中渲染的3D模型。 它還可以幫助您導(dǎo)入，查看和構(gòu)建3D資產(chǎn) 。

構(gòu)建您的第一個(gè)ARCore應(yīng)用 (Building your first ARCore app)

Now with our Android Studio setup complete and Sceneform SDK installed, we can get started with writing our very first ARCore app.

現(xiàn)在，我們完成了Android Studio設(shè)置并安裝了Sceneform SDK，我們可以開始編寫我們的第一個(gè)ARCore應(yīng)用程序了。

First, we need to add the Sceneform fragment to our layout file. This will be the Scene where we place all our 3D models. It takes care of the camera initialization and permission handling.

首先，我們需要將Sceneform片段添加到布局文件中。 這將是我們放置所有3D模型的場(chǎng)景。 它負(fù)責(zé)相機(jī)的初始化和權(quán)限處理。

Head over to your main layout file. In my case it is activity_main.xml and add the Sceneform fragment:

轉(zhuǎn)到您的主布局文件。 在我的情況下，它是activity_main.xml并添加Sceneform片段：

<?xml version="1.0" encoding="utf-8"?><FrameLayout xmlns:android="http://schemas.android.com/apk/res/android" xmlns:tools="http://schemas.android.com/tools" android:layout_width="match_parent" android:layout_height="match_parent" tools:context=".MainActivity"><fragment android:name="com.google.ar.sceneform.ux.ArFragment" android:id="@+id/ux_fragment" android:layout_width="match_parent" android:layout_height="match_parent" /></FrameLayout>

I’ve set the width and height to match parent as this will cover my entire activity. You can choose the dimensions according to your requirements.

我將寬度和高度設(shè)置為與父項(xiàng)匹配，因?yàn)檫@將覆蓋我的整個(gè)活動(dòng)。 您可以根據(jù)需要選擇尺寸。

兼容性檢查 (Compatibility Check)

This is all that you need to do in the layout file. Now head over to the java file, in my case which is MainActivity.java. Add the method below in your class:

這是您在布局文件中需要做的所有事情。 現(xiàn)在轉(zhuǎn)到Java文件，在我的例子中是MainActivity.java。 在您的課程中添加以下方法：

public static boolean checkIsSupportedDeviceOrFinish(final Activity activity) { if (Build.VERSION.SDK_INT < Build.VERSION_CODES.N) { Log.e(TAG, "Sceneform requires Android N or later"); Toast.makeText(activity, "Sceneform requires Android N or later", Toast.LENGTH_LONG).show(); activity.finish(); return false; } String openGlVersionString = ((ActivityManager) activity.getSystemService(Context.ACTIVITY_SERVICE)) .getDeviceConfigurationInfo() .getGlEsVersion(); if (Double.parseDouble(openGlVersionString) < MIN_OPENGL_VERSION) { Log.e(TAG, "Sceneform requires OpenGL ES 3.0 later"); Toast.makeText(activity, "Sceneform requires OpenGL ES 3.0 or later", Toast.LENGTH_LONG) .show(); activity.finish(); return false; } return true;}

This method checks whether your device can support Sceneform SDK or not. The SDK requires Android API level 27 or newer and OpenGL ES version 3.0 or newer. If a device does not support these two, the Scene would not be rendered and your application will show a blank screen.

此方法檢查您的設(shè)備是否可以支持Sceneform SDK。 該SDK需要Android API級(jí)別27或更高版本以及OpenGL ES 3.0版或更高版本。 如果設(shè)備不支持這兩個(gè)設(shè)備，則不會(huì)渲染場(chǎng)景，并且您的應(yīng)用程序?qū)@示空白屏幕。

Although, you can still continue to deliver all the other features of your app which don’t require the Sceneform SDK.

不過，您仍然可以繼續(xù)提供應(yīng)用程序的所有其他功能，這些功能不需要Sceneform SDK。

Now with the device compatibility check complete, we shall build our 3D model and attach it to the scene.

現(xiàn)在完成設(shè)備兼容性檢查后，我們將構(gòu)建3D模型并將其附加到場(chǎng)景。

添加資產(chǎn) (Adding the assets)

You will need to add the 3D models which will be rendered on your screen. Now you can build these models yourself if you are familiar with 3D model creation. Or, you can visit Poly.

您將需要添加將在屏幕上渲染的3D模型。 現(xiàn)在，如果您熟悉3D模型創(chuàng)建，則可以自己構(gòu)建這些模型。 或者，您可以訪問Poly。

There you’ll find a huge repository of 3D assets to choose from. They are free to download. Just credit the creator and you are good to go.

在那里，您將找到龐大的3D資產(chǎn)存儲(chǔ)庫供您選擇。 可以免費(fèi)下載。 只要相信創(chuàng)作者，您就可以開始了。

In the Android Studio, expand your app folder available on the left-hand side project pane. You’ll notice a “sampledata” folder. This folder will hold all of your 3D model assets. Create a folder for your model inside the sample data folder.

在Android Studio中，展開左側(cè)項(xiàng)目窗格上可用的應(yīng)用程序文件夾。 您會(huì)注意到一個(gè)“ sampledata ”文件夾。 該文件夾將保存您的所有3D模型資源。 在樣本數(shù)據(jù)文件夾中為您的模型創(chuàng)建一個(gè)文件夾。

When you download the zip file from poly, you will most probably find 3 files.

從poly下載zip文件時(shí)，很可能會(huì)找到3個(gè)文件。

.mtl file

.mtl文件

.obj file

.obj文件

.png file

.png文件

Most important of these 3 is the .obj file. It is your actual model. Place all the 3 files inside sampledata -> “your model’s folder”.

這3個(gè)文件中最重要的是.obj文件。 這是您的實(shí)際模型。 將所有3個(gè)文件放在sampledata- >“模型的文件夾 r”中。

Now right click on the .obj file. The first option would be to Import Sceneform Asset. Click on it, do not change the default settings, just click finish on the next window. Your gradle will sync to include the asset in the assets folder. Once the gradle build finishes, you are good to go.

現(xiàn)在，右鍵單擊.obj 文件 。 第一個(gè)選項(xiàng)是導(dǎo)入Sceneform Asset。 單擊它，不更改默認(rèn)設(shè)置，只需在下一個(gè)窗口中單擊完成。 您的gradle將同步以將資產(chǎn)包括在資產(chǎn)文件夾中。 一旦gradle構(gòu)建完成，您就可以開始了。

You’ve finished importing a 3D asset used by Sceneform in your project. Next, let’s build the asset from our code and include it in the scene.

您已完成在項(xiàng)目中導(dǎo)入Sceneform使用的3D資源。 接下來 ，讓我們從代碼中構(gòu)建資產(chǎn)并將其包含在場(chǎng)景中。

建立模型 (Building the Model)

Add the following code to your MainActivity.java file (or whatever it is in your case). Don’t worry, I’ll explain all the code line by line:

將以下代碼添加到MainActivity.java文件(或您的情況)中。 不用擔(dān)心，我將逐行解釋所有代碼：

private static final String TAG = MainActivity.class.getSimpleName();private static final double MIN_OPENGL_VERSION = 3.0;ArFragment arFragment;ModelRenderable lampPostRenderable;@Override@SuppressWarnings({"AndroidApiChecker", "FutureReturnValueIgnored"})protected void onCreate(Bundle savedInstanceState) { super.onCreate(savedInstanceState); if (!checkIsSupportedDeviceOrFinish(this)) { return; } setContentView(R.layout.activity_main); arFragment = (ArFragment) getSupportFragmentManager().findFragmentById(R.id.ux_fragment);ModelRenderable.builder() .setSource(this, Uri.parse("LampPost.sfb")) .build() .thenAccept(renderable -> lampPostRenderable = renderable) .exceptionally(throwable -> { Toast toast = Toast.makeText(this, "Unable to load andy renderable", Toast.LENGTH_LONG); toast.setGravity(Gravity.CENTER, 0, 0); toast.show(); return null; });}

First, we find the arFragment that we included in the layout file. This fragment is responsible for hosting the scene. You can think of it as the container of our scene.

首先 ，我們找到包含在布局文件中的arFragment 。 該片段負(fù)責(zé)主持場(chǎng)景。 您可以將其視為我們場(chǎng)景的容器。

Next, we are using the ModelRenderable class to build our model. With the help of setSource method, we load our model from the .sfb file. This file was generated when we imported the assets. thenAccept method receives the model once it is built. We set the loaded model to our lampPostRenderable.

接下來 ，我們使用ModelRenderable類構(gòu)建模型。 借助setSource方法，我們從中加載了模型。 sfb文件。 該文件是在我們導(dǎo)入資產(chǎn)時(shí)生成的。 構(gòu)建模型后， thenAccept方法將接收模型。 我們將加載的模型設(shè)置為lampPostRenderable。

For error handling, we have .exceptionally method. It is called in case an exception is thrown.

對(duì)于錯(cuò)誤處理，我們有.exceptionally方法。 如果引發(fā)異常，則調(diào)用該方法。

All this happens asynchronously, hence you don’t need to worry about multi-threading or deal with handlers XD

所有這些都是異步發(fā)生的，因此您無需擔(dān)心多線程或處理XD處理程序。

With the model loaded and stored in the lampPostRenderable variable, we’ll now add it to our scene.

將模型加載并存儲(chǔ)在lampPostRenderable變量中之后，我們現(xiàn)在將其添加到場(chǎng)景中。

將模型添加到場(chǎng)景 (Adding the Model to Scene)

The arFragment hosts our scene and will receive the tap events. So we need to set the onTap listener to our fragment to register the tap and place an object accordingly. Add the following code to onCreate method:

arFragment托管我們的場(chǎng)景，并將接收點(diǎn)擊事件。 因此，我們需要將onTap偵聽器設(shè)置為片段，以注冊(cè)拍擊并相應(yīng)地放置一個(gè)對(duì)象。 將以下代碼添加到onCreate方法：

arFragment.setOnTapArPlaneListener( (HitResult hitresult, Plane plane, MotionEvent motionevent) -> { if (lampPostRenderable == null){ return; }Anchor anchor = hitresult.createAnchor(); AnchorNode anchorNode = new AnchorNode(anchor); anchorNode.setParent(arFragment.getArSceneView().getScene());TransformableNode lamp = new TransformableNode(arFragment.getTransformationSystem()); lamp.setParent(anchorNode); lamp.setRenderable(lampPostRenderable); lamp.select(); });

We set the onTapArPlaneListener to our AR fragment. Next what you see is the Java 8 syntax, in case you are not familiar with it, I would recommend checking out this guide.

我們將onTapArPlaneListener設(shè)置為我們的AR片段 。 接下來，您會(huì)看到Java 8語法 ，如果您不熟悉Java 8語法 ，我建議您查閱本指南 。

First, we create our anchor from the HitResult using hitresult.createAnchor() and store it in an Anchor object.

首先，我們使用hitresult.createAnchor()從HitResult創(chuàng)建錨，并將其存儲(chǔ)在Anchor對(duì)象中。

Next, create a node out of this anchor. It will be called AnchorNode. It will be attached to the scene by calling the setParent method on it and passing the scene from the fragment.

接下來 ，從該錨點(diǎn)創(chuàng)建一個(gè)節(jié)點(diǎn)。 它將被稱為AnchorNode。 通過在其上調(diào)用setParent方法并從片段傳遞場(chǎng)景，將其附加到場(chǎng)景。

Now we create a TransformableNode which will be our lamppost and set it to the anchor spot or our anchor node. The node still doesn’t have any information about the object it has to render. We’ll pass that object using lamp.setRenderable method which takes in a renderable as it’s parameter. Finally call lamp.select();

現(xiàn)在，我們創(chuàng)建一個(gè)TransformableNode ，將其作為路燈柱并將其設(shè)置為錨點(diǎn)或錨節(jié)點(diǎn)。 該節(jié)點(diǎn)仍然沒有任何有關(guān)它必須呈現(xiàn)的對(duì)象的信息。 我們將使用lamp.setRenderable方法傳遞該對(duì)象， 該方法以renderable作為參數(shù)。 最后調(diào)用lamp.select();

Phew!! Too much terminology there, but don’t worry, I’ll explain it all.

ew！ 那里的術(shù)語太多了，但是請(qǐng)放心，我將全部解釋。

Scene: This is the place where all your 3D objects will be rendered. This scene is hosted by the AR Fragment which we included in the layout. An anchor node is attached to this screen which acts as the root of the tree and all the other objects are rendered as its objects.

場(chǎng)景 ：這是將渲染所有3D對(duì)象的地方。 該場(chǎng)景由我們包含在布局中的AR片段托管。 此屏幕上附加了一個(gè)錨點(diǎn)，該錨點(diǎn)充當(dāng)樹的根，所有其他對(duì)象均渲染為其樹對(duì)象。

HitResult: This is an imaginary line (or a ray) coming from infinity which gives the point of intersection of itself with a real-world object.

HitResult ：這是一條來自無限遠(yuǎn)的假想線(或射線)，它給出了其與現(xiàn)實(shí)世界對(duì)象的交點(diǎn)。

Anchor: An anchor is a fixed location and orientation in the real world. It can be understood as the x,y,z coordinate in the 3D space. You can get an anchor’s post information from it. Pose is the position and orientation of the object in the scene. This is used to transform the object’s local coordinate space into real-world coordinate space.

錨點(diǎn) ：錨點(diǎn)是現(xiàn)實(shí)世界中的固定位置和方向。 可以理解為3D空間中的x，y，z坐標(biāo)。 您可以從中獲取主播的信息。 姿勢(shì)是場(chǎng)景中對(duì)象的位置和方向。 這用于將對(duì)象的局部坐標(biāo)空間轉(zhuǎn)換為實(shí)際坐標(biāo)空間。

AnchorNode: This is the node that automatically positions itself in the world. This is the first node that gets set when the plane is detected.

AnchorNode：這是自動(dòng)將自己放置在世界上的節(jié)點(diǎn)。 這是檢測(cè)到平面時(shí)設(shè)置的第一個(gè)節(jié)點(diǎn)。

TransformableNode: It is a node that can be interacted with. It can be moved around, scaled rotated and much more. In this example, we can scale the lamp and rotate it. Hence the name Transformable.

TransformableNode ：它是可以與之交互的節(jié)點(diǎn)。 它可以移動(dòng)，縮放旋轉(zhuǎn)等等。 在此示例中，我們可以縮放燈并旋轉(zhuǎn)。 因此，名稱為可變形。

There is no rocket science here. It’s really simple. The entire scene can be viewed as a graph with Scene as the parent, AnchorNode as its child and then branching out different nodes/objects to be rendered on the screen.

這里沒有火箭科學(xué)。 真的很簡單。 可以將整個(gè)場(chǎng)景視為一個(gè)圖形，以Scene為父級(jí)， AnchorNode作為其子級(jí)，然后分支出要在屏幕上呈現(xiàn)的不同節(jié)點(diǎn)/對(duì)象。

Your final MainActivity.java must look something like this:

您最終的MainActivity.java必須看起來像這樣：

package com.ayusch.arcorefirst;import android.app.Activity;import android.app.ActivityManager;import android.content.Context;import android.net.Uri;import android.os.Build;import android.support.v7.app.AppCompatActivity;import android.os.Bundle;import android.util.Log;import android.view.Gravity;import android.view.MotionEvent;import android.widget.Toast;import com.google.ar.core.Anchor;import com.google.ar.core.HitResult;import com.google.ar.core.Plane;import com.google.ar.sceneform.AnchorNode;import com.google.ar.sceneform.rendering.ModelRenderable;import com.google.ar.sceneform.ux.ArFragment;import com.google.ar.sceneform.ux.TransformableNode;public class MainActivity extends AppCompatActivity { private static final String TAG = MainActivity.class.getSimpleName(); private static final double MIN_OPENGL_VERSION = 3.0;ArFragment arFragment; ModelRenderable lampPostRenderable;@Override @SuppressWarnings({"AndroidApiChecker", "FutureReturnValueIgnored"}) protected void onCreate(Bundle savedInstanceState) { super.onCreate(savedInstanceState); if (!checkIsSupportedDeviceOrFinish(this)) { return; } setContentView(R.layout.activity_main); arFragment = (ArFragment) getSupportFragmentManager().findFragmentById(R.id.ux_fragment);ModelRenderable.builder() .setSource(this, Uri.parse("LampPost.sfb")) .build() .thenAccept(renderable -> lampPostRenderable = renderable) .exceptionally(throwable -> { Toast toast = Toast.makeText(this, "Unable to load andy renderable", Toast.LENGTH_LONG); toast.setGravity(Gravity.CENTER, 0, 0); toast.show(); return null; });arFragment.setOnTapArPlaneListener( (HitResult hitresult, Plane plane, MotionEvent motionevent) -> { if (lampPostRenderable == null){ return; }Anchor anchor = hitresult.createAnchor(); AnchorNode anchorNode = new AnchorNode(anchor); anchorNode.setParent(arFragment.getArSceneView().getScene());TransformableNode lamp = new TransformableNode(arFragment.getTransformationSystem()); lamp.setParent(anchorNode); lamp.setRenderable(lampPostRenderable); lamp.select(); } );}public static boolean checkIsSupportedDeviceOrFinish(final Activity activity) { if (Build.VERSION.SDK_INT < Build.VERSION_CODES.N) { Log.e(TAG, "Sceneform requires Android N or later"); Toast.makeText(activity, "Sceneform requires Android N or later", Toast.LENGTH_LONG).show(); activity.finish(); return false; } String openGlVersionString = ((ActivityManager) activity.getSystemService(Context.ACTIVITY_SERVICE)) .getDeviceConfigurationInfo() .getGlEsVersion(); if (Double.parseDouble(openGlVersionString) < MIN_OPENGL_VERSION) { Log.e(TAG, "Sceneform requires OpenGL ES 3.0 later"); Toast.makeText(activity, "Sceneform requires OpenGL ES 3.0 or later", Toast.LENGTH_LONG) .show(); activity.finish(); return false; } return true; }}

Congratulations!! You’ve just completed your first ARCore app. Start adding objects and see them come alive in the real world!

恭喜!! 您剛剛完成了第一個(gè)ARCore應(yīng)用。 開始添加對(duì)象，看看它們?cè)诂F(xiàn)實(shí)世界中變得栩栩如生！

This was your first look into how to create a simple ARCore app from scratch with Android studio. In the next tutorial, I would be going deeper into ARCore and adding more functionality to the app.

這是您第一次了解如何使用Android Studio從頭開始創(chuàng)建簡單的ARCore應(yīng)用 。 在下一個(gè)教程中，我將更深入地研究ARCore并為該應(yīng)用程序添加更多功能。

If you have any suggestions or any topic you would want a tutorial on, just mention in the comments section and I’ll be happy to oblige.

如果您有任何建議或主題想要在本教程上學(xué)習(xí)，請(qǐng)?jiān)谠u(píng)論部分中提及，我們非常樂意為您服務(wù)。

Like what you read? Don’t forget to share this post on Facebook, Whatsapp and LinkedIn.

喜歡你讀的書嗎？ 不要忘記在Facebook ， Whatsapp和LinkedIn上分享此帖子。

You can follow me on LinkedIn, Quora, Twitter and Instagram where I answer questions related to Mobile Development, especially Android and Flutter.

您可以在LinkedIn ， Quora ， Twitter和Instagram上關(guān)注我，在那里我回答與移動(dòng)開發(fā)(尤其是Android和Flutter)有關(guān)的問題 。

翻譯自: https://www.freecodecamp.org/news/how-to-build-an-augmented-reality-android-app-with-arcore-and-android-studio-43e4676cb36f/

arcore

總結(jié)

以上是生活随笔為你收集整理的arcore_如何使用ARCore和Android Studio构建增强现实Android应用的全部內(nèi)容，希望文章能夠幫你解決所遇到的問題。

如果覺得生活随笔網(wǎng)站內(nèi)容還不錯(cuò)，歡迎將生活随笔推薦給好友。