architecture

Data Governance solution for Databricks, Synapse and ADLS gen2

落花浮王杯 提交于 2020-06-10 06:43:25
问题 I'm new to data governance, forgive me if question lack some information. Objective We're building data lake & enterprise data warehouse from scratch for mid-size telecom company on Azure platform. We're using ADLS gen2, Databricks and Synapse for our ETL processing, data science, ML & QA activities. We already have about a hunder of input tables and 25 TB/yearly. In future we're expecting more. Business has a strong requirements incline towards cloud-agnostic solutions. Still they are okay

How do I create boundaries for my microservices?

余生颓废 提交于 2020-06-01 05:13:51
问题 We have a monolithic web based CRUD application (call it A ) which does a certain task. Now, we have a new requirement which is more or less independent of A functionally. The audience is different, the times of use, the functionality etc. are all different. Because of this, we decided to build this into a new service B . The problem started when B required authentication information from A . Anticipating that this might happen again, we pulled out the auth from A and put it as separate

How to implement undo functionality?

半世苍凉 提交于 2020-05-24 23:01:26
问题 In my application I want to provide the user with a small undo functionality. There aren't many actions than can be undone by the user. Particularly the actions are: Add notes to an object Color an object Tag a objcet with a string Now I thought about how to implement this. I first thought of a Action Class that is the abstract base class for the 3 different actions that can be taken by the user. Every time the user takes on of these actions, a new appropriate instance of a subclass of this

TDD: best practices mocking stacks of objects

自作多情 提交于 2020-05-16 19:09:51
问题 I'm trying to get familiar with unit testing in PHP with a small API in Lumen. Writing the first few tests was pretty nice with the help of some tutorials but now I encountered a point where I have to mock/ stub a dependency. My controller depends on a specific custom interface type hinted in the constructor. Of course, I defined this interface/implementation-binding within a ServiceProvider. public function __construct(CustomValidatorContract $validator) { // App\Contracts

Generalization and Specialization - What is the differences

坚强是说给别人听的谎言 提交于 2020-05-15 05:18:22
问题 I am having a hard time actually finding the difference between a Generalization and a Specialization, and when to use either one. Can anyone enlighten me? Eventually also an illustration using UML 回答1: Animal is a generalization , Dog is specialization. Your superclass is a generalized class , but your subclass will be a specialized inheritor of your superclass. It becomes more specialized and less generalized as you move down the inheritance hierarchy . Generalization Generalization is the

Flutter BLoC: Is using nested StreamBuilders a bad practice?

三世轮回 提交于 2020-05-15 04:21:09
问题 Is there a better way to expose a widget to two or more streams from different BLoCs? So far I have been using nested StreamBuilder 's for as many streams as I need listening to like the pasted code below. Is this a good practice? StreamBuilder( stream: firstBloc.stream1, builder: (_, AsyncSnapshot snapshot1) { return StreamBuilder( stream: secondBloc.stream2, builder: (_, AsyncSnapshot snapshot2) { return CustomWidget(snapshot1.data, snapshot2.data); } ) } ) Using rxdart operators like

Keep reference on view/data model after View update

我们两清 提交于 2020-05-10 06:14:08
问题 Consider we have a RootView and a DetailView . DetailView has it's own BindableObject, let's call it DetailViewModel and we have scenario: RootView may be updated by some kind of global event e.g. missed internet connection or by it's own data/view model When RootView handling event it's content is updated and this is causes new struct of DetailView to be created If DetailViewModel is created by DetailView on init, there would be another reference of DetailViewModel and it's state (e.g.

User specific connection string in EntityFramework .net core

混江龙づ霸主 提交于 2020-04-18 05:45:56
问题 We are developing a multitenant app using .net core and EntityFramework. There will be a single deployed instance of APIs but multiple DBS( one DB per user). So what's the best strategy change DB connection string as per-user context. 回答1: Set the connection string in the OnConfiguring method of DbContext , by calling UseSqlServer , or whatever your database is. In this method, you need to have a reference to some service that will provide the user-specific connection. For this, IMO, the best

GPU - System memory mapping

谁说胖子不能爱 提交于 2020-04-07 15:44:09
问题 How system memory (RAM) is mapped for GPU access? I am clear about how virtual memory works for cpu but am not sure how would that work when GPU accesses GPU-mapped system memory (host). Basically something related to how Data is copied from system-memory to host-memory and vice versa. Can you provide explanations backed by reference articles please? 回答1: I found the following slideset quite useful: http://developer.amd.com/afds/assets/presentations/1004_final.pdf MEMORY SYSTEM ON FUSION APUS

GPU - System memory mapping

最后都变了- 提交于 2020-04-07 15:43:29
问题 How system memory (RAM) is mapped for GPU access? I am clear about how virtual memory works for cpu but am not sure how would that work when GPU accesses GPU-mapped system memory (host). Basically something related to how Data is copied from system-memory to host-memory and vice versa. Can you provide explanations backed by reference articles please? 回答1: I found the following slideset quite useful: http://developer.amd.com/afds/assets/presentations/1004_final.pdf MEMORY SYSTEM ON FUSION APUS