Tencent IEG open source AI SDK: automatic testing of chicken eating and MoBa games

Yueyue 2021-02-23 15:32:26
tencent ieg open source ai


Almost Human reports

edit : Chen Ping 、 Devil

SDK It can also play games automatically ? This SDK somewhat 「 cool 」.


 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games

In recent days, , Tencent Entertainment (IEG) Open source a project called GAME AI SDK Automated test platform for , The platform encapsulates a variety of tools for developers to use , Currently, the types of games supported are Parkour 、 Eat chicken 、 Shooting category 、MOBA Class etc. .

Project address :https://github.com/Tencent/GameAISDK


 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games


 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games

Platform built in 「 Cool run every day 」 Example . The picture on the left shows the untrained random action , The picture on the right shows the effect of training .

SDK( Software development kit ) It's usually a software engineer for a specific package 、 software framework 、 Hardware platform 、 Operating system and other development tools that can be used to create application software .

It seems a little abstract . In the actual project , We just need to remember ,SDK It's provided by mobile game channel , Integrated user login 、 Community function 、 Social sharing 、 Function module of data background statistics function . Access SDK after , Game manufacturers and channels should be right SDK Package to test , Only after passing the test can we go online .

Look at the cool running picture shown above , Do you want to try chicken 、 Shooting game experience ? This open source project can meet your needs , It supports users to access projects and secondary development .

AI SDK platform

AI SDK The platform is a platform for developing games based on game images AI Open Source Toolkit for . It's mainly done UI testing 、 In game element recognition 、AI Algorithm (DQN、IM) And so on . Developers can complete the game automation test based on this toolkit .

At present, the game types supported by the platform are Parkour 、 Eat chicken 、 Shooting category 、MOBA Class etc. . It can replace the artificial automation of the game scene in specific scenarios , Reduce the manpower investment in game scenario testing .

The toolkit mainly includes AI SDK、AI Client、SDKTool( Profile tool ) These parts .

SDKTool Help us generate game specific AI SDK Required profile . For example, in the course of the game , Action interaction is needed in the whole process UI、 Game elements that need to be identified, etc .AI The information used in the development process can come from game images (AI Client obtain ) Or other data .AI SDK Able to automate the game UI Operate and enter the game scene , Operate the mobile phone to play games like a player .

Function introduction

GAME AI SDK The platform has the following functions :

Provides a variety of image recognition algorithms , Identify key feature data in the game scene , Such as the skill state in the game scene 、 Button position 、 Target location, etc .

Provide imitation learning and reinforcement learning AI Algorithm , It can be directly used in training game scenes AI.

It provides a complete set of sample collection 、 Image annotation tool .

AI SDK Module introduction

AI SDK It mainly includes AI Client modular 、MC modular 、IO modular 、UI modular 、GameReg modular 、AI modular .


 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games

chart 1:AI SDK Module diagram .

AI Client It mainly interacts with the mobile terminal , Get game images , And implement UI or AI Output action ;

IO Module and AI Client Interaction , As AI SDK Data input and output control ;

MC Module and IO Module interaction , Distribute data to AI SDK Back end UI and AI modular , And do some business logic management control ;

UI Module based on game image , Identify what needs to be done UI operation ;

GameReg Module based on game image , Identify the numbers in the game scene 、 Blood strip 、 Objects and other elements ;

AI Module based on the identified game elements , according to AI Algorithms perform business logic .


 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games

chart 2: Architecture diagram .

The deployment environment

function AI SDK Medium demo, First you need to install the dependency , And then local PC Mobile phone connected to mobile phone ( Or mobile phone emulator ), adopt AI Client Real time collection of mobile phones ( Or mobile phone emulator ) Game screen of , And to the AI Service processing . hold AI The action result of service processing is fed back to the connection PC On my cell phone , Complete the interaction of actions .


 tencent IEG Open source AI SDK: Automated test eating chicken 、MOBA Class games

chart 3:AI SDK Interaction diagram with mobile phone .

Deployment depends on the environment

The deployment dependent environment is mainly installation AI SDK、SDKTool( Configuration file generation tool )、AI Client The environment depends on .

The project provides two kinds of operating system deployment process .

Ubuntu: at present SDK The toolkit runs on 16.04 Of 64 position Ubuntu On the system , The deep learning framework used is TensorFlow, So before you use it, you need to install the dependent ubuntu The system and the corresponding dependent third party toolkits , Such as TensorFlow、OpenCV、protobuf etc. .


The environment mainly depends on nvdia-cuda 9.0、cudnn 7.0、opencv 3.4.2、protobuf 3.2.0、android adb、poster Toolsets and other dependency packages . Please refer to :https://github.com/Tencent/GameAISDK/blob/master/doc/environment/InstallStepByStep.md.

Windows:SDK The package comes with the dependent package file to be installed 「requirements.txt」, therefore windows Next, just install 「requirements.txt」 Dependency in . Please refer to :https://github.com/Tencent/GameAISDK/blob/master/doc/environment/SDKToolEnv.md.

Besides , The project also introduces the profile tool SDK Tool、 Project access 、 Secondary development and debugging skills , Please refer to the project link for details .

Reference link :

https://ieg.tencent.com/

https://github.com/Tencent/GameAISDK

版权声明
本文为[Yueyue]所创,转载请带上原文链接,感谢
https://javamana.com/2021/02/20210223151343888e.html

  1. docker入门到熟练
  2. Java之HTTP网络编程(一):TCP/SSL网页下载
  3. Introduction to docker
  4. HTTP network programming in Java (1): TCP / SSL web page download
  5. mysql 的ACID以及隔离级别
  6. Acid and isolation level of MySQL
  7. Java序列化对字段名的影响
  8. The influence of Java serialization on field names
  9. Redis 日志篇:系统高可用的杀手锏
  10. Java中把一个对象复制给另外一个对象引发的思考
  11. Java之HTTP网络编程(一):TCP/SSL网页下载
  12. Redis log: the killer of system high availability
  13. Thinking about copying one object to another in Java
  14. HTTP network programming in Java (1): TCP / SSL web page download
  15. 数据库--oracle安装配置(本地安装的步骤及各种问题解决方案)
  16. 从事Java9年,27天熬夜把近年遇到的面试题收录成册全网开源!
  17. Database -- Oracle installation configuration (local installation steps and various problem solutions)
  18. Engaged in Java for 9 years, 27 days stay up late, the interview questions encountered in recent years included into a volume, the whole network open source!
  19. Java序列化 / 调用 Wildfly 服务接口异常:EJBCLIENT000409
  20. docker-compose部署Estack
  21. Redis 日志篇:系统高可用的杀手锏
  22. Java中把一个对象的值复制给另外一个对象引发的思考
  23. Java serialization / call wildfly service interface exception: ejbclient000409
  24. Docker compose deploy stack
  25. Mac下查看已安装的jdk版本及其安装目录
  26. Redis log: the killer of system high availability
  27. mybatis映射xml配置文件报错:<statement> or DELIMITER expected, got ‘id‘
  28. Thinking about copying the value of one object to another in Java
  29. IntelliJ IDEA 还能画思维导图,果然最强 IDE!
  30. vue使用sdk进行七牛云上传
  31. IntelliJ IDEA 还能画思维导图,果然最强 IDE!
  32. Spring原来还可以这么玩!阿里新产Spring全线宝典成功颠覆了我对Spring的认知!
  33. View the installed JDK version and its installation directory under mac
  34. Error in mybatis mapping XML configuration file: < statement > or delay expected, got 'ID‘
  35. IntelliJ IDEA 还能画思维导图,果然最强 IDE!
  36. Javascript性能优化【内联缓存】 V8引擎特性
  37. IntelliJ idea can also draw mind maps. It's really the strongest ide!
  38. Vue uses SDK to upload Qi Niu cloud
  39. IntelliJ idea can also draw mind maps. It's really the strongest ide!
  40. 深入理解 Web 协议 (三):HTTP 2
  41. Spring can still play like this! Ali's new spring product has successfully overturned my understanding of spring!
  42. IntelliJ idea can also draw mind maps. It's really the strongest ide!
  43. JavaScript performance optimization [inline cache] V8 engine features
  44. linux 配置java环境
  45. linux find 查找文件
  46. 深入理解 Web 协议 (三):HTTP 2
  47. IntelliJ IDEA 相关问题记录
  48. Deep understanding of Web protocol (3): http 2
  49. 深入理解 Web 协议 (三):HTTP 2
  50. 腾讯IEG开源AI SDK:自动化测试吃鸡、MOBA类游戏
  51. Mysql Command
  52. Configuring Java environment with Linux
  53. Find files in Linux
  54. docker-Dockerfile 创建镜像
  55. Redis Cluster
  56. 深入理解 Web 协议 (三):HTTP 2
  57. JavaScriptBOM操作
  58. JavaScriptBOM操作
  59. Deep understanding of Web protocol (3): http 2
  60. Record of IntelliJ idea related problems