Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GPU Support for tensorflow lite #1532

Open
wants to merge 28 commits into
base: master
Choose a base branch
from
Open

GPU Support for tensorflow lite #1532

wants to merge 28 commits into from

Conversation

barrypitman
Copy link

This PR includes some changes to enable building tensorflow-lite with -DTFLITE_ENABLE_GPU=ON for linux x64-64.

There are still some outstanding issues though:

  • for linux-x86_64 (-gpu), its building the jar file, but then failing during staging / deploy based on the tensorflow-lite/platform/gpu/pom.xml that I provided.
  • for android it's failing because of TfLiteGpuDelegateV2CreateAsync
  • for windows I think that the target functions aren't available since tflite doesn't support GPU on Windows, but I'm not sure how to conditionally exclude them

@barrypitman
try build GPU version of tflite for linux x86_64
6783eb2
@barrypitman
fix extension '-gpu' and not 'gpu'
90090a9
@barrypitman
attach the installed artifacts
a770534
@barrypitman
trigger tflite build
5f9b5f2
@barrypitman
refer to our own version of the ubuntu build which will attach artifacts
dac6dc9
@barrypitman
refer to our own version of the ubuntu build which will attach artifacts
ca050e8
@barrypitman
refer to our own version of the ubuntu build which will attach artifacts
7f72a1b
@barrypitman
refer to our own version of the ubuntu build which will attach artifacts
da830fc
@barrypitman
refer to our own version of the ubuntu build which will attach artifacts
b49f365
@barrypitman
trigger rebuild
06608c0
@barrypitman
provide different names for artifacts
000b538
@barrypitman
try to generate GPU delegate
b247282
@barrypitman
try to generate GPU delegate
0816ed0
@barrypitman
add missing delegate_options
95590cc
@barrypitman
add other header files for gpu extension
11023db
@barrypitman
try suggestions from bytedeco#1529 (comment)
2de3669
@barrypitman
remove the exclusion of android
ff22226
@barrypitman
define #if defined(__ANDROID__)
5e0d80e
@barrypitman
copy approach from tensorflow (full)
8bc91df
@barrypitman
don't define TfLiteGpuDelegateV2CreateAsync
e12b7b3
@barrypitman
skip based on linePatterns
af595d4
@barrypitman
Merge branch 'master' of github.com:barrypitman/javacpp-presets into …
f45c2bb 
…v1.5.10-GPU

# Conflicts:
#	tensorflow-lite/src/main/java/org/bytedeco/tensorflowlite/presets/tensorflowlite.java
@barrypitman
sync with main
4aaa421
@barrypitman
sync with main
a0c311d
@barrypitman
gpu_invoke_loop_times
7fef1bc
@barrypitman
cleanup
c369391
@barrypitman
define TfLiteGpuDelegateV2CreateAsync function for android
13c95d5
@barrypitman
define TfLiteGpuDelegateV2CreateAsync function for android
5890823
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
enhancement help wanted
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@barrypitman @saudet