Giter VIP home page Giter VIP logo

reark's Introduction

Reference Architecture for Android using RxJava

Build Status

This is an ambitious reference project of what can be done with RxJava to create an app based on streams of data.

High-level architecture

In the repository you will find several library-like solutions that might or might not be reusable. Parts of the architecture are, however, already used in real applications, and as the parts mature they are likely to be extracted into separate libraries. If you follow the general guidelines illustrated here, your application should be in a position to have portions of it easily replaced as more or less official solutions emerge. The architecture is designed to support large-scale applications with remote processes, such as those used in widgets.

The project uses the open GitHub repositories API. You might hit a rate limit if you use the API extensively.

Including in an Android Project

allprojects {
    repositories {
      ...
      maven { url 'https://jitpack.io' }
    }
}

dependencies {
    implementation 'com.github.reark:reark:0.3'
}

Alternatively, you may consider including Reark as a Git submodule.

Application Structure

To use the app start writing a search in the text box of at least 3 characters. This will trigger a network request and the five first results of which will be shown as a list. The input also throttled in a way that makes it trigger when the user stops typing. This is a very good basic example of Rx streams.

.filter((string) -> string.length() > 2) .debounce(500, TimeUnit.MILLISECONDS)

The Basic Data Flow

As seen above, the user input is turned into a series of strings in the View layer, which the View Model then processes.

When we are ready to execute the actual search, an Intent is broadcast and the NetworkService handles it, starting a network request in its own remote process. Once the network request is finished, NetworkService inserts the fetched data into the ContentProviders of GitHubRepositorySearchStore and GitHubRepositoryStore. All of the interested processes are notified through the onChange mechanism of ContentProviders.

The search store contains only the ids of the results of the query, while the actual repository POJOs are written in the repository store. A repository POJO can thus be contained in multiple searches, which can often be the case if the first match stays the same, for instance.

This structure nevertheless enables us to keep the data consistent across the application—even if the same data object is updated from multiple APIs.

Tests

You can run the test(s) on command line in the project folder:

./gradlew test

Currently the tests are not extensive, but we are working on it. The View Models in particular will be fully unit tested.

View Models

This architecture makes use of View Models, which are not commonly used in Android applications.

View Model (VM) encapsulates the state of a view and the logic related to it into a separate class. This class is independent of the UI platform and can be used as the “engine” for several different fragments. The view is a dumb rendering component that displays the state as constructed in the VM.

Possible values that the view model can expose:

  • Background color
  • Page title text resource id
  • Selected tab index
  • Animation state of a sliding menu

The same VM can be used with entirely different views—for instance one on tablet and another one on mobile. The VM is also relatively easy to unit test and immune to changes in the platform.

An Android Approach to View Models

For our purposes let us treat fragments as the entry point to the view layer. The view layer is an abstraction and is not to be confused with the Android View class, the descendants of which will still be used for displaying the data once the Fragment has received the latest values from the VM. The point is our fragments will not contain any program logic.

The goal is to take all data retrieval and data processing away from the fragments and encapsulate it into a nice and clean View Model. This VM can then be unit tested and re-used where ever applicable.

In this example project we use RxJava to establish the necessary observable/observer patterns to connect the view model to the view, but an alternative solution could be used as well.

The View Model Life Cycle

View Model has two important responsibilities:

  • Retrieve data from a data source
  • Expose the data as simple values to the view layer (fragments)

The suggested VM life cycle is much like that of fragment, and not by coincidence.

View Model life cycle

The data layer offers a permanent subscription to a data source, and it pushes a new item whenever new data arrives. This connection should be established in onViewCreated and released in onViewDestroyed. More details of a good data layer architecture will follow in another article.

It is a good idea to separate the data subscription and the data retrieval. You first passively subscribe to a data stream, and then you use another method to start the retrieval of new items for that particular stream (most commonly via http). This way, if desired, you are able to refresh the data multiple times without needing to break the subscription—or in some cases not to refresh it at all but use the latest cached value.

Exposing View Model Properties

Strictly speaking there are two kinds of properties

  • Actual properties, such as boolean flags
  • Events

In RxJava the actual properties would typically be stored as BehaviorSubjects and exposed as Observables. This way whoever subscribes to the property will immediately receive the latest value and update the UI, even if the value had been updated while paused.

In the second case, where the property is used for events, you might want to opt for a simple PublishSubject that has no “memory”. When onResume is called the UI would not receive any events that occurred while paused.

Threading and Testing View Models

While it is possible to use TestSchedulers, I believe it is best to keep the VMs simple and not to include threading in them. If there is a risk some of the inputs to the VM come from different threads you can use thread-safe types or declare fields as volatile.

The safest way to ensure the main thread is to use .observeOn(AndroidSchedulers.mainThread()) when the fragment subscribes to the VM properties. This makes the subscription to always trigger asynchronously, but usually it is more of a benefit than a disadvantage.

Data Layer

The application specific Data Layer is responsible for fetching and storing data. A fetch operation updates the centrally stored values in ContentProviders and everyone who is interested will get the update.

For a stream of data we use the DataStreamNotification, which differs slightly from the typical RxJava Notification.

  • The observable never completes: there could always be new data
  • Errors in fetching the data do not break the subscription: once the problem is resolved the data starts to flow again
  • FetchStart event is sent when a network operation is start and it can be used to display loading state in the UI

Currently only the GitHubRepositorySearch supports DataStreamNotifications, though it is not difficult to add to any data type.

Consuming Data in the View

When data comes in we render it in the view, simple as that. It does not actually matter what triggered the update of the data—it could be a background sync, user pressing a button or a change in another part of the UI. The data can arrive at any given time and any number of times.

Store

Store is a container that allows subscribing to data of a particular type and identification. Whenever data requested becomes available, a new immutable value is pushed as onNext to all subscribers. The Store does not concern itself with where the data comes from.

Conceptually the concrete backing of a Store can be a static in-memory hash, plain SQLite or a ContentProvider. In case the same data is to be used from multiple processes there needs to be a mechanism that detects changes in the persisted data and propagates them to all subscribers. Android ContentProviders, of course, do this automatically, making them the perfect candidates.

In this example project the Stores are backed by SQLite ContentProviders, which serializes the values as JSON strings with an id column for queries. This could be optimized by adding columns for all fields of the POJO, but on the other hand it adds boilerplate code that has to be maintained. In case of performance problems the implementation can be changed without affecting the rest of the application.

For caching purposes it is usually good to include timestamps into the structure of the Store. Determining when to update the data is not conceptually not a concern of the Store, though, it simply holds the data. Cache-expiry of the data is still on the list of things-to-do in this reference project.

Fetcher

The responsibilities of the Fetcher are:

  • Send and process the network requests
  • Populate Stores with the received values
  • Update the NetworkRequestState of fetch operations
  • Filter duplicate ongoing requests

The Fetchers run exclusively in the NetworkService, making them hidden from the rest of the application. NetworkService has its own ServiceDataLayer that allows it to trigger fetch operations.

License

The MIT License

Copyright (c) 2013-2017 reark project contributors

https://github.com/reark/reark/graphs/contributors

Permission is hereby granted, free of charge, to any person obtaining a copy
of this software and associated documentation files (the "Software"), to deal
in the Software without restriction, including without limitation the rights
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
copies of the Software, and to permit persons to whom the Software is
furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in
all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
THE SOFTWARE.

reark's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

reark's Issues

Sample using the RxJava based architecture with ListViews

I'm curious to see how you use this similar approach with list views, adapters and the view model. Do you use the subjects to publish results, and as the results are published, add them as single items to the list adapter?

Alternatively, do you publish a chunk of results for the list, and just set the items on the adapter with one swoop?

Cancelling requests

Should support cancelling network requests. Currently requests are executed even if no-one is interested in the results any more.

Alternative for ContentProvider

You prepared a great example project. But I have one issue. Can we use alternative ways to observe data changes instead of ContentProvider. For example SQLBrite, or simple SQL query?

Move fetchers into a separate remote Service

To share the going network request pool as well as to be able to update data from outside of the app, the data fetching should be mored into a dedicated bound service. The service could be a bound service that reports errors in the fetching to the initiator and push the request results into the shared ContentProvider.

ContentProviderStoreCoreBase.applyOperations() flatMap issue

    private Observable<CoreOperationResult> applyOperations(@NonNull final List<CoreOperation> operations) {
        return Observable.fromCallable(() -> {
                    ArrayList<ContentProviderOperation> contentOperations = contentOperations(operations);
                    return contentResolver.applyBatch(getAuthority(), contentOperations);
                })
                .doOnNext(result -> Log.v(TAG, String.format("Applied %s operations", result.length)))
                .flatMap(Observable::fromArray)
                .zipWith(operations, CoreOperationResult::new);
    }

As I understand this code, it tries to zip the input (operations) with the results of applyBatch(): then flatMap() must not be used, because it does not guarantee the order, right?

Create ReactiveValue to expose properties to Views

It is sometimes necessary to expose properties from ViewModels as static values, i.e. in the style of viewModel.getPropertyX().getLastValue(). This is especially true with platform components, which inherently hold a lot of state. While it would be nice to pretend it is possible to build an app without, the support should probably be added to open a shortcut for consuming values from Views.

Permission denied (missing INTERNET permission?)

Caused by: rx.exceptions.OnErrorNotImplementedException: Permission denied (missing INTERNET permission?)
            at rx.Observable$32.onError(Observable.java:7255)
            at rx.observers.SafeSubscriber._onError(SafeSubscriber.java:154)
            at rx.observers.SafeSubscriber.onError(SafeSubscriber.java:111)
            at rx.internal.operators.OperatorMap$1.onError(OperatorMap.java:49)
            at rx.internal.operators.OperatorSubscribeOn$1$1$1.onError(OperatorSubscribeOn.java:71)
            at com.tehmou.rxbookapp.data.DataLayer.lambda$getGitHubRepositorySearch$5(DataLayer.java:43)
            at com.tehmou.rxbookapp.data.DataLayer.access$lambda$0(DataLayer.java)
            at com.tehmou.rxbookapp.data.DataLayer$$Lambda$1.call(Unknown Source)
            at rx.Observable.unsafeSubscribe(Observable.java:7428)

Querying local database is done on the UI thread.

Code located inside ContentProviderStoreBase.java is doing IO operations on the UI thread:

 protected T query(Uri uri) {
        Cursor cursor = contentResolver.query(uri, SerializedJsonContract.PROJECTION, null, null, null);
        T value = null;
        if (cursor != null) {
            if (cursor.moveToFirst()) {
                final String json = cursor.getString(cursor.getColumnIndex(SerializedJsonContract.JSON));
                value = new Gson().fromJson(json, type);
            } else {
                Log.v(TAG, "Could not find with id: " + uri);
            }
            cursor.close();
        }
        Log.d(TAG, "" + value);
        return value;
    }

Make a widget that follows a repository

  • It would be a good illustration of the ContentProvider architecture to make a a widget that shares the data with the app
  • This could be the main use case of the app
  • Either a normal widget or a floating widget view

Add possibility to use hashed URI in the network request store

For instance, for security reasons we might not want to store the full URI in the network request store. Suggested change is to provide a possibility to use a hash function for all URIs stored in the store. This would also make it possible to change the hash based on possible POST parameters.

Default groupOperations() from ContentProviderStoreCoreBase doesn't buffer last emitted item

Default groupOperations() from io.reark.reark.data.stores.cores.ContentProviderStoreCoreBase doesn't buffer last emitted item if
groupMaxSize == total number of items emitted by source observable so far
stackoverflow

By the way are these changes reasonable to avoid possible multi-threading problems?

@NonNull
private final Subject<CoreValue<U>, CoreValue<U>> operationSubject =
        PublishSubject.<CoreValue<U>>create().toSerialized();

private AtomicInteger nextOperationIndex = new AtomicInteger(0);

completionNotifiers.put(index, PublishSubject.<Boolean>create().toSerialized());

Find real data APIs to use

  • The mockup data layer is not sufficient to provide a good usage scenario
  • It would be better to make a real, working application

.

(wrong project!)

image

Feature request/Implementation guideline to fetch a list from SingleItemContentProviderStore

I am trying to use this pattern for a sample app. I need to implement an API which returns a list of objects.Where I am stuck is how to leverage the SingleItemContentProviderStore in that case.Because this works based on an id identifier.Any ideas?

EDIT : I can use getStream() , however this too would return individual item observables,however this still wont work well with a ListView,RecyclerView

Child ViewModels

Add a mechanism to have nested ViewModels that inherit the lifecycle of their parent. These could be lists of varying lengths.

Handling Activity switch

Can you please explain how you would handle switsches between Activities (or Fragments) in this approach? Which component would be responsible to start a new Activity after a Buttonclick in the view?
Thanks & greetings

Implement a proper fetcher

  • Add a fetcher for GitHub searches that ascertains a request is not unnecessarily triggered twice if it is already in progress

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.