Is it correct to convert a CompletableFuture<Stream<T>> to a Publisher<T>?

我怕爱的太早我们不能终老 提交于 2019-12-05 10:46:39

问题


To allow multiple iterations on the resulting stream from a CompletableFuture<Stream<String>> I am considering one of the following approaches:

  1. Convert the resulting future to CompletableFuture<List<String>> through: teams.thenApply(st -> st.collect(toList()))

  2. Convert the resulting future to Flux<String> with cache: Flux.fromStream(teams::join).cache();

Flux<T> is the implementation of Publisher<T> in project reactor.

Use case:

I would like to get a sequence with the premier league teams names (e.g. Stream<String>) from a data source which provides a League object with a Standing[] (based on football-data RESTful API, e.g. http://api.football-data.org/v1/soccerseasons/445/leagueTable). Using AsyncHttpClient and Gson we have:

CompletableFuture<Stream<String>> teams = asyncHttpClient
    .prepareGet("http://api.football-data.org/v1/soccerseasons/445/leagueTable")
    .execute()
    .toCompletableFuture()
    .thenApply(Response::getResponseBody)
    .thenApply(body -> gson.fromJson(body, League.class));
    .thenApply(l -> stream(l.standings).map(s -> s.teamName));

To re-use the resulting stream I have two options:

1. CompletableFuture<List<String>> res = teams.thenApply(st -> st.collect(toList()))

2. Flux<String> res = Flux.fromStream(teams::join).cache()

Flux<T> is less verbose and provides all that I need. Yet, is it correct to use it in this scenario?

Or should I use CompletableFuture<List<String>> instead? Or is there any other better alternative?

UPDATED with some thoughts (2018-03-16):

CompletableFuture<List<String>>:

  • [PROS] The List<String> will be collected in a continuation and when we need to proceed with the result of the future, maybe it is already completed.
  • [CONS] Declaration verbosity.
  • [CONS] If we just want to use it once, then we did not need to collect those items in a List<T>.

Flux<String>:

  • [PROS] Declaration conciseness
  • [PROS] If we just want to use it once, then we can omit .cache() and forward it to the next layer, which can take advantage of the reactive API, e.g. web flux reactive controller, e.g. @GetMapping(produces =MediaType.TEXT_EVENT_STREAM) public Flux<String> getTeams() {…}
  • [CONS] If we want to reuse that Flux<T> we have to wrap it in a cacheable Flux<T> (….cache()) which in turn will add overhead on the first traversal, because it has to store the resulting items in an internal cache.

回答1:


    CompletableFuture<Stream<String>> teams = ...;
    Flux<String> teamsFlux = Mono.fromFuture(teams).flatMapMany(stream -> Flux.fromStream(stream));
EDIT:

Flux.fromStream(teams::join) is a code smell because it's holding a thread to fetch the result from CompletableFuture which is running on another thread.




回答2:


Once you have downloaded the league table, and the team names are extracted from this table, I'm not sure you need a back-pressure ready stream to iterate over these items. A conversion of the stream to a standard list (or array) should be good enough, and should probably have better performance, no?

For instance:

String[] teamNames = teams.join().toArray(String[]::new);


来源:https://stackoverflow.com/questions/49203360/is-it-correct-to-convert-a-completablefuturestreamt-to-a-publishert

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!