ab-testing

问题 I am trying to create an experiment using Firebase remote config. The criteria is as follows: It should target only new users who have not used the app ( opening the app for the first time) Now on further research I found that there is a user property as below: However, this is not available in the experiment window or a similar property that fulfils the above criteria in the Firebase console as seen below: I can only see the user properties set by my code. One way I can think of is to use

问题 I am trying to create an experiment using Firebase remote config. The criteria is as follows: It should target only new users who have not used the app ( opening the app for the first time) Now on further research I found that there is a user property as below: However, this is not available in the experiment window or a similar property that fulfils the above criteria in the Firebase console as seen below: I can only see the user properties set by my code. One way I can think of is to use

问题 I am trying to create an experiment using Firebase remote config. The criteria is as follows: It should target only new users who have not used the app ( opening the app for the first time) Now on further research I found that there is a user property as below: However, this is not available in the experiment window or a similar property that fulfils the above criteria in the Firebase console as seen below: I can only see the user properties set by my code. One way I can think of is to use

问题 I wanted to perform two A/B tests on an app using Firebase A/B Testing with Remote Config. The problem is that the two tests audiences should be mutually exclusive. Forming part of both experiments might pollute the results. I've thought in setting a Firebase Analytics user property when the user enters in the Experiment 1 and excluding this property value from Experiment 2 audience, but I'm afraid that the user enters in both experiments simultaneously when fetching the Remote Config values.

问题 I wanted to perform two A/B tests on an app using Firebase A/B Testing with Remote Config. The problem is that the two tests audiences should be mutually exclusive. Forming part of both experiments might pollute the results. I've thought in setting a Firebase Analytics user property when the user enters in the Experiment 1 and excluding this property value from Experiment 2 audience, but I'm afraid that the user enters in both experiments simultaneously when fetching the Remote Config values.

来源： https://stackoverflow.com/questions/54956460/need-of-bonferroni-correction-in-a-b-testing

问题 I've configured firebase ab-testing. Everything works fine except there is no impact user on console. Actually, I can see UI and log show ab-testing is applied. Moreover, by checking the other StackoverFlow topic, activateFetched also invoked after fetch successfully. Moreover, I've referenced Firebase Remote Config A/B testing shows no results after 24 hours Firebase Remote Config results on initial request Remote Config A/B Test does not provide results on iOS But those are no work on my

问题 I've got a number of different views that need to share the same experiment (ie footer and header partial need to both show 'nav_a' or 'nav_b' option). I had hoped that simply having the same named experiment would make this work but it seems to not (ie sometimes the header has 'a' and the footer has 'b', vice versa or the same a on both). How could I best achieve this? As a secondary question, part of my 'experiment' is knowing which view was more successful on getting users to click on a

问题 I've had an A/B Test running in Google Web Optimizer for six weeks now, and there's still no end in sight. Google is still saying: "We have not gathered enough data yet to show any significant results. When we collect more data we should be able to show you a winning combination." Is there any way of telling how close Google is to making up its mind? (Does anyone know what algorithm does it use to decide if there's been any "high confidence winners"?) According to the Google help

问题 I have created and started an A/B Test on Firebase Remote Config 2 days ago on my iOS app with this code: [FIRApp configure]; [FIRRemoteConfig.remoteConfig fetchWithCompletionHandler:^(FIRRemoteConfigFetchStatus status, NSError * _Nullable error) { // Do nothing }]; [FIRRemoteConfig.remoteConfig activateFetched]; I have confirmed that the test is live because on some devices I can see the test going on. The problem is that, after two days, the Firebase Console keeps saying that 0 users have