fastlane-old / scan Goto Github PK

View Code? Open in Web Editor NEW

221.0 221.0 25.0 949 KB

The easiest way to run tests of your iOS and Mac app

Home Page: https://fastlane.tools

scan's People

Contributors

Stargazers

Watchers

scan's Issues

Add link to action in fastlane

I can't always remember the syntax of the action, what if we had a link for the "Scan is part of fastlane" bit of the readme for the fastlane action itself.

Of course this will be made easier when we add support for actions plugins.

Slack Required?

This doesn't seem necessary. We don't use Slack at all, so I have nothing to enter here.

Selecting a wrong simulator (os version)

Running scan from fastlane with following parameters:

device: iPhone 5s
sdk: "iphonesimulator9.0"

I got the following xcodebuild arguments (from the build log):

-sdk 'iphonesimulator9.0'
-destination 'platform=iOS Simulator,id=A70AFADC-5845-4BAD-BC78-54A751CF2B85'

But I actually this device is not 9.0:

iPhone 5s (8.1) [A70AFADC-5845-4BAD-BC78-54A751CF2B85]
iPhone 5s (8.2) [CB02ACE4-2529-4C4B-80BE-6AA2F98FDE91]
iPhone 5s (8.3) [418F47F3-2340-4980-BEB6-3C7A4730878C]
iPhone 5s (9.0) [50C14962-815D-49D9-9130-99A6E7DF80C7]

Is it a bug, or I should select OS by setting explicit destination, like this:
destination: "platform=iOS Simulator,name=iPhone 5s,OS=9.0"

Thank you!!

Couldn't parse the number of tests from the output

I get the following after running scan.

[14:29:41]: Couldn't parse the number of tests from the output
/Users/pi/.gem/gems/scan-0.1.0/lib/scan/runner.rb:52:in `handle_results': undefined method `>' for nil:NilClass (NoMethodError)
        from /Users/pi/.gem/gems/scan-0.1.0/lib/scan/runner.rb:10:in `run'
        from /Users/pi/.gem/gems/scan-0.1.0/lib/scan/manager.rb:10:in `work'
        from /Users/pi/.gem/gems/scan-0.1.0/lib/scan/commands_generator.rb:41:in `block (2 levels) in run'
        from /Users/pi/.gem/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
        from /Users/pi/.gem/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
        from /Users/pi/.gem/gems/commander-4.3.5/lib/commander/command.rb:153:in `run'
        from /Users/pi/.gem/gems/commander-4.3.5/lib/commander/runner.rb:428:in `run_active_command'
        from /Users/pi/.gem/gems/commander-4.3.5/lib/commander/runner.rb:68:in `run!'
        from /Users/pi/.gem/gems/commander-4.3.5/lib/commander/delegates.rb:15:in `run!'
        from /Users/pi/.gem/gems/scan-0.1.0/lib/scan/commands_generator.rb:60:in `run'
        from /Users/pi/.gem/gems/scan-0.1.0/lib/scan/commands_generator.rb:14:in `start'
        from /Users/pi/.gem/gems/scan-0.1.0/bin/scan:6:in `<top (required)>'
        from /Users/pi/.gem/bin/scan:23:in `load'
        from /Users/pi/.gem/bin/scan:23:in `<main>'

I'm not really sure what additional information will be useful to you here, but shoot me a message if there's something in particular. I have the full log (795KB - 338 tests) if you need it but it contains some pre-release info in there so I'd rather it wasn't public 😉

Specified destination not in list of valid destinations

Hi,

I recently attempted to migrate my Fastfile from using Xcodebuild to using Scan, but encountered the following error on our CI server: Unable to find a destination matching the provided destination specifier.

Our server has a large number of devices, and I was able to find that the ID Scan was looking for belonged to a device with an older version of iOS - one that wasn't supported by my app.

This appears to be caused by only filtering based on the device's name (as seen on this line), rather than a combination of it's name and desired version. Ideally this the desired version could be determined automatically, perhaps based on the deployment target. As a simpler alternative it could be passed as a parameter.

Thank you for your time and the excellent suite of tools!
Noah

Specify simulator iOS version

FastlaneCore::Simulator.all already informs ios_version, so it should be easy to add this.

Add support to share test results for use in other actions

It would be great if the tests results were shared so they could be used in other actions to allow for keeping analytics or forming custom messages to team chat.

Crash on build when executing test on project with appname containing a simple quote (')

Issue b1453ecee8c346abeaa057febff059f0

[10:52:22]: set -o pipefail && env NSUnbufferedIO=YES xcodebuild -workspace './FidMarques.xcworkspace' -scheme 'sa-production' -destination 'platform=iOS Simulator,id=55B224A6-563F-4DB5-818A-A5948F38B356' -enableCodeCoverage YES clean build test | tee '/Users/valentin/Library/Logs/scan/Savourez l'Alsace-sa-production.log' | xcpretty
Loading...
sh: -c: line 0: unexpected EOF while looking for matching `''
sh: -c: line 1: syntax error: unexpected end of file
sh: -c: line 0: unexpected EOF while looking for matching `''
sh: -c: line 1: syntax error: unexpected end of file
[10:52:22]: Exit status: 2
[10:52:22]: Variable Dump:
[10:52:22]: {:DEFAULT_PLATFORM=>:ios, :ENVIRONMENT=>"sla", :PLATFORM_NAME=>:ios, :LANE_NAME=>"ios test"}
[10:52:22]: Error building/testing the application - see the log above

Bug : My app name contains a simple quote, causing the build to crash

Solution : Replace all simple quotes of the generated command by escaped double quotes in https://github.com/fastlane/scan/blob/master/lib/scan/test_command_generator.rb

Slack Notification channel

Right now scan reports the test results in the channel linked to the webhook. Is there any chance that you can add a parameter so we can post it to a particular channel (basically the same setting as the slack action in fastlane)?

Thanks

What's the recommended way to watch files for changes?

You know — it'd be nice to run unit tests on every file save, just like Scala's sbt does — so that you get feedback after a few seconds of editing without necessarily having to manually run your tests all the time.

It'd be great if scan could provide a flag that accepts a GLOB, and it basically watches out for those files changing and triggers test runs. This is a use-case for developers rather than deployment.

To address the inevitable debate about the grand UNIX philosophy, and that scan should only do one thing and one thing well, I say: sure. I get that. It's the responsibility of fswatch or whatever to to trigger scan multiple times.

But whenever I've ever tried to do this, there are always issues: IDE's often change many files all at once and produce tonnes of file change events, causing too many builds to get queued — there's a lack of a throttling mechanism. The console output becomes unmanageable.

So what do you think? Perhaps scan could help us out here?

Large project build log is truncated

When running scan in my large project, log output in ~/Library/Logs/scan is truncated. The log file saved is 148MB but is missing a large chunk of the beginning of the build output.

Can't post my build output but happy to provide any other info.

Crash after generating reports

Hey

After running scan for my test target everything runs smoothly, but it ends ungracefully:

/Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/runner.rb:69:in `handle_results': Tests failed (RuntimeError)
        from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/runner.rb:10:in `run'
        from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/manager.rb:10:in `work'
        from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/commands_generator.rb:41:in `block (2 levels) in run'
        from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
        from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
        from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:153:in `run'
        from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/runner.rb:428:in `run_active_command'
        from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/runner.rb:68:in `run!'
        from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/delegates.rb:15:in `run!'
        from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/commands_generator.rb:60:in `run'
        from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/commands_generator.rb:14:in `start'
        from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/bin/scan:6:in `<top (required)>'
        from /usr/local/bin/scan:23:in `load'
        from /usr/local/bin/scan:23:in `<main>'

My specs:

OS X 10.11.1
ruby 2.0.0p645 (2015-04-13 revision 50299) [universal.x86_64-darwin15]
zsh 5.1.1 (x86_64-apple-darwin15.0.0) with tmux

Scan should use scheme setting for code coverage

Hi,

I think scan should use scheme setting for code coverage by default and maybe be overladed by code_coverage setting.

Cheers,

skip_html_open should default to true

As a tool primarily intended to be used on CI systems, skip_html_open defaulting to false makes no sense. It should default to true.

Add support for output_name parameter

It would be nice if it was possible to specify the name of the output file (similar to gym's output_name parameter).
We are running our tests on Bamboo but the Junit Parser plugin only seems to parse files with an .xml extension. We currently have to manually rename the output file report.junit to have the .xml extension.

SCAN_DEVICE works when running scan directly, fails when running fastlane

I've got an interesting issue. When I run scan directly with a custom device ("platform=iOS Simulator,OS=9.1,name=iPhone 6"), it works fine:

11:11:39 {fastlane branch} ~/GIT/AFNetworking $ scan -w AFNetworking.xcworkspace/ -s "AFNetworking iOS" -d "platform=iOS Simulator,OS=9.1,name=iPhone 6"
[11:12:27]: xcrun xcodebuild -list -workspace 'AFNetworking.xcworkspace/'
[11:12:27]: xcrun xcodebuild -showBuildSettings -workspace 'AFNetworking.xcworkspace/' -scheme 'AFNetworking iOS'
[11:12:29]: It's not recommended to set the `destination` value directly
[11:12:29]: Instead use the other options available in `scan --help`
[11:12:29]: Using your value 'platform=iOS Simulator,OS=9.1,name=iPhone 6' for now
[11:12:29]: because I trust you know what you're doing...

+-----------------------+---------------------------+
|              Summary for scan 0.2.1               |
+-----------------------+---------------------------+
| workspace             | AFNetworking.xcworkspace/ |
| scheme                | AFNetworking iOS          |
| clean                 | false                     |
| output_directory      | ./test_output             |
| output_types          | html,junit                |
| buildlog_path         | ~/Library/Logs/scan       |
| open_report           | false                     |
| skip_slack            | false                     |
| slack_only_on_failure | false                     |
+-----------------------+---------------------------+

[11:12:29]: set -o pipefail && xcodebuild -workspace 'AFNetworking.xcworkspace/' -scheme 'AFNetworking iOS' -destination 'platform=iOS Simulator,OS=9.1,name=iPhone 6' build test | tee '/Users/kevin.harwood/Library/Logs/scan/AFNetworking iOS Tests-AFNetworking iOS.log' | xcpretty 
Loading...
▸ Building AFNetworking/AFNetworking iOS [Debug]
▸ Check Dependencies
▸ Building AFNetworking/AFNetworking iOS Tests [Debug]
▸ Check Dependencies
▸ Build Succeeded
2015-11-02 11:12:31.420 xcodebuild[38345:466382] [MT] IDETestOperationsObserverDebug: (BF2D408D-8534-4A91-BAB5-E94BD4374B8D) Beginning test session BF2D408D-8534-4A91-BAB5-E94BD4374B8D with Xcode 7B91b on target <DVTiPhoneSimulator: 0x7ffa9de6bab0> {
SimDevice: SimDevice : iPhone 6 (72BDC9AB-C83D-425C-974D-1395D4B012FD) : state={ Shutdown } deviceType={ SimDeviceType : com.apple.CoreSimulator.SimDeviceType.iPhone-6 } runtime={ SimRuntime : 9.1 (13B137) - com.apple.CoreSimulator.SimRuntime.iOS-9-1 }
} (9.1 (13B137))
▸ Building AFNetworking/AFNetworking iOS [Debug]
▸ Check Dependencies
▸ Building AFNetworking/AFNetworking iOS Tests [Debug]
▸ Check Dependencies
Selected tests
Test Suite AFNetworking iOS Tests.xctest started
AFAutoPurgingImageCacheTests
✓ testDuplicateImageAddedToCacheIsReturned (0.018 seconds)
yada...yada...yada...

When I create a fastlane, and setup an env file, it fails to find that simulator:

env file:

SCAN_DEVICE="platform=iOS Simulator,OS=9.1,name=iPhone 6"

fastlane:

11:13:26 {fastlane branch} ~/GIT/AFNetworking $ fastlane test --env ios.91
[11:16:14]: -------------------------------------------------
[11:16:14]: --- Step: Verifying required fastlane version ---
[11:16:14]: -------------------------------------------------
[11:16:14]: fastlane version valid
[11:16:14]: ------------------------------
[11:16:14]: --- Step: default_platform ---
[11:16:14]: ------------------------------
[11:16:14]: Loading from './fastlane/.env.ios.91'
[11:16:14]: Driving the lane 'ios test' 🚀
[11:16:14]: ------------------
[11:16:14]: --- Step: scan ---
[11:16:14]: ------------------
[11:16:14]: xcrun xcodebuild -list -workspace 'AFNetworking.xcworkspace'
[11:16:15]: xcrun xcodebuild -showBuildSettings -workspace 'AFNetworking.xcworkspace' -scheme 'AFNetworking iOS'
[11:16:17]: Couldn't find simulator 'platform=iOS Simulator,OS=9.1,name=iPhone 6' - falling back to default simulator

+-----------------------+---------------------------------------------+
|                       Summary for scan 0.2.1                        |
+-----------------------+---------------------------------------------+
| workspace             | AFNetworking.xcworkspace                    |
| device                | platform=iOS Simulator,OS=9.1,name=iPhone 6 |
| scheme                | AFNetworking iOS                            |
| clean                 | false                                       |
| output_directory      | ./test_output                               |
| output_types          | html,junit                                  |
| buildlog_path         | ~/Library/Logs/scan                         |
| sdk                   | iphonesimulator9.1                          |
| open_report           | false                                       |
| skip_slack            | false                                       |
| slack_only_on_failure | false                                       |
+-----------------------+---------------------------------------------+

[11:16:17]: set -o pipefail && xcodebuild -workspace 'AFNetworking.xcworkspace' -scheme 'AFNetworking iOS' -sdk 'iphonesimulator9.1' -destination 'platform=iOS Simulator,id=AFAA5B6A-F6CC-458F-BE1E-5CD852CC6E54' build test | tee '/Users/kevin.harwood/Library/Logs/scan/AFNetworking iOS Tests-AFNetworking iOS.log' | xcpretty 
Loading...
▸ Building AFNetworking/AFNetworking iOS [Debug]
▸ Check Dependencies
▸ Building AFNetworking/AFNetworking iOS Tests [Debug]
▸ Check Dependencies
▸ Build Succeeded
2015-11-02 11:16:19.593 xcodebuild[38535:470668] [MT] IDETestOperationsObserverDebug: (0C665657-1576-42BC-A570-DFECE5440DB3) Beginning test session 0C665657-1576-42BC-A570-DFECE5440DB3 with Xcode 7B91b on target <DVTiPhoneSimulator: 0x7faf8cc909a0> {
SimDevice: SimDevice : iPhone 5s (AFAA5B6A-F6CC-458F-BE1E-5CD852CC6E54) : state={ Shutdown } deviceType={ SimDeviceType : com.apple.CoreSimulator.SimDeviceType.iPhone-5s } runtime={ SimRuntime : 9.1 (13B137) - com.apple.CoreSimulator.SimRuntime.iOS-9-1 }
} (9.1 (13B137))
▸ Building AFNetworking/AFNetworking iOS [Debug]
▸ Check Dependencies
▸ Building AFNetworking/AFNetworking iOS Tests [Debug]
▸ Check Dependencies
Selected tests
Test Suite AFNetworking iOS Tests.xctest started
AFAutoPurgingImageCacheTests
✓ testDuplicateImageAddedToCacheIsReturned (0.025 seconds)
yada...yada...yada

Am I doing something wrong there?

xcpretty-travis-formatter: command not found for Jenkins build

scan works fine for me on the command line, but when I try to run it as part of a Jenkins build, it fails with the message, "xcpretty-travis-formatter: command not found". I installed the xcpretty-travis-formatter gem on the Jenkins server and the error still occurs.

Here's more of the log:

+-----------------------+---------------------+
|           Summary for scan 0.1.2            |
+-----------------------+---------------------+
| workspace             | Sphere.xcworkspace  |
| device                | iPhone 6s           |
| scheme                | Sphere              |
| clean                 | false               |
| output_directory      | ./test_output       |
| output_types          | html,junit          |
| buildlog_path         | ~/Library/Logs/scan |
| open_report           | false               |
| skip_slack            | false               |
| slack_only_on_failure | false               |
+-----------------------+---------------------+

�[37m[01:36:52]: �[0m�[32mAutomatically switched to Travis formatter�[0m
�[37m[01:36:52]: �[0m�[33mset -o pipefail && xcodebuild -workspace 'Sphere.xcworkspace' -scheme 'Sphere' -destination 'platform=iOS Simulator,id=661D3781-0957-4BB4-B8C8-B023C6BA15D2' test | tee '/Users/Shared/Jenkins/Library/Logs/scan/Sphere-Sphere.log' | xcpretty -f `xcpretty-travis-formatter`�[0m
�[36mLoading...�[0m
�[36msh: xcpretty-travis-formatter: command not found�[0m
�[36m/Library/Ruby/Gems/2.0.0/gems/xcpretty-0.2.0/bin/xcpretty:69:in `block in <top (required)>': missing argument: -f (OptionParser::MissingArgument)�[0m
�[36mfrom /Library/Ruby/Gems/2.0.0/gems/xcpretty-0.2.0/bin/xcpretty:27:in `new'�[0m
�[36mfrom /Library/Ruby/Gems/2.0.0/gems/xcpretty-0.2.0/bin/xcpretty:27:in `<top (required)>'�[0m
�[36mfrom /Library/ruby/bin/xcpretty:23:in `load'�[0m
�[36mfrom /Library/ruby/bin/xcpretty:23:in `<main>'�[0m
�[36m2015-10-24 01:36:53.396 xcodebuild[4173:20756] [MT] IDETestOperationsObserverDebug: (66631C85-7E3F-499B-BDF7-DDB20472079B) Beginning test session 66631C85-7E3F-499B-BDF7-DDB20472079B with Xcode 7B91b on target <DVTiPhoneSimulator: 0x7fc3c6982460> {�[0m
�[36mSimDevice: SimDevice : iPhone 6s (661D3781-0957-4BB4-B8C8-B023C6BA15D2) : state={ Shutdown } deviceType={ SimDeviceType : com.apple.CoreSimulator.SimDeviceType.iPhone-6s } runtime={ SimRuntime : 9.1 (13B137) - com.apple.CoreSimulator.SimRuntime.iOS-9-1 }�[0m
�[36m} (9.1 (13B137))�[0m
sh: xcpretty-travis-formatter: command not found
/Library/Ruby/Gems/2.0.0/gems/xcpretty-0.2.0/bin/xcpretty:69:in `block in <top (required)>': missing argument: -f (OptionParser::MissingArgument)
from /Library/Ruby/Gems/2.0.0/gems/xcpretty-0.2.0/bin/xcpretty:27:in `new'
from /Library/Ruby/Gems/2.0.0/gems/xcpretty-0.2.0/bin/xcpretty:27:in `<top (required)>'
from /Library/ruby/bin/xcpretty:23:in `load'
from /Library/ruby/bin/xcpretty:23:in `<main>'
2015-10-24 01:36:53.396 xcodebuild[4173:20756] [MT] IDETestOperationsObserverDebug: (66631C85-7E3F-499B-BDF7-DDB20472079B) Beginning test session 66631C85-7E3F-499B-BDF7-DDB20472079B with Xcode 7B91b on target <DVTiPhoneSimulator: 0x7fc3c6982460> {
SimDevice: SimDevice : iPhone 6s (661D3781-0957-4BB4-B8C8-B023C6BA15D2) : state={ Shutdown } deviceType={ SimDeviceType : com.apple.CoreSimulator.SimDeviceType.iPhone-6s } runtime={ SimRuntime : 9.1 (13B137) - com.apple.CoreSimulator.SimRuntime.iOS-9-1 }
} (9.1 (13B137))
�[37m[01:37:18]: �[0mExit status: 1
�[37m[01:37:19]: �[0m�[32mSuccessfully sent Slack notification�[0m
�[37m[01:37:19]: �[0m�[33mVariable Dump:�[0m
�[37m[01:37:19]: �[0m{:DEFAULT_PLATFORM=>:ios, :PLATFORM_NAME=>:ios, :LANE_NAME=>"ios beta"}
�[1m�[31m[01:37:19]: �[0m�[0m�[31mError building/testing the application - see the log above�[0m

+------+-------------------------------------+-------------+
|                     �[32mfastlane summary�[0m                     |
+------+-------------------------------------+-------------+
| Step | Action                              | Time (in s) |
+------+-------------------------------------+-------------+
| 1    | Verifying required fastlane version | 0           |
| 2    | default_platform                    | 0           |
| 3    | scan                                | 31          |
+------+-------------------------------------+-------------+

�[1m�[31m[01:37:19]: �[0m�[0m�[31mfastlane finished with errors�[0m

scan hangs after running tests (process doesn't exit; I'm not returned to the shell)

I'm using scan to run my iOS app tests. I'm invoking it merely as 'scan' in the root of my iOS project. It runs all the tests but then just hangs. By 'hang' I mean that control isn't returned to the shell, I have to do CTRL-C.

When I do CTRL-C I see the following text:


        Executed 181 tests, with 0 failures (0 unexpected) in 41.231 (45.663) seconds


^C/Library/Ruby/Gems/2.0.0/gems/fastlane_core-0.27.0/lib/fastlane_core/command_executor.rb:27:in `each': Interrupt
    from /Library/Ruby/Gems/2.0.0/gems/fastlane_core-0.27.0/lib/fastlane_core/command_executor.rb:27:in `block in execute'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane_core-0.27.0/lib/fastlane_core/command_executor.rb:26:in `spawn'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane_core-0.27.0/lib/fastlane_core/command_executor.rb:26:in `execute'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/runner.rb:23:in `test_app'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/runner.rb:9:in `run'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/manager.rb:10:in `work'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/commands_generator.rb:41:in `block (2 levels) in run'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:153:in `run'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/runner.rb:428:in `run_active_command'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/runner.rb:68:in `run!'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/delegates.rb:15:in `run!'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/commands_generator.rb:60:in `run'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/lib/scan/commands_generator.rb:14:in `start'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.3.2/bin/scan:6:in `<top (required)>'
    from /usr/bin/scan:23:in `load'
    from /usr/bin/scan:23:in `<main>'

I've tried invoking scan by using fastlane and a Fastfile and the same thing happens.

Device selection not working

When I want to run the tests with scan on a specific device, I get the following output:

$ scan --workspace "MyProject.xcworkspace" --scheme "MyProjectTests" --skip_slack --device "iPhone 6"
[09:13:20]: xcrun xcodebuild -list -workspace 'MyProject.xcworkspace'
[09:13:21]: xcrun xcodebuild -showBuildSettings -workspace 'MyProject.xcworkspace' -scheme 'MyProjectTests'
/Users/myUser/.rvm/gems/ruby-2.2.0/gems/scan-0.1.0/lib/scan/detect_values.rb:29:in `block in default_device': undefined method `strip' for true:TrueClass (NoMethodError)
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/scan-0.1.0/lib/scan/detect_values.rb:29:in `each'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/scan-0.1.0/lib/scan/detect_values.rb:29:in `find'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/scan-0.1.0/lib/scan/detect_values.rb:29:in `default_device'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/scan-0.1.0/lib/scan/detect_values.rb:19:in `set_additional_default_values'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/scan-0.1.0/lib/scan.rb:25:in `config='
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/scan-0.1.0/lib/scan/manager.rb:4:in `work'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/scan-0.1.0/lib/scan/commands_generator.rb:41:in `block (2 levels) in run'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/commander-4.3.5/lib/commander/command.rb:153:in `run'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/commander-4.3.5/lib/commander/runner.rb:428:in `run_active_command'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/commander-4.3.5/lib/commander/runner.rb:68:in `run!'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/commander-4.3.5/lib/commander/delegates.rb:15:in `run!'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/scan-0.1.0/lib/scan/commands_generator.rb:60:in `run'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/scan-0.1.0/lib/scan/commands_generator.rb:14:in `start'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/gems/scan-0.1.0/bin/scan:6:in `<top (required)>'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/bin/scan:23:in `load'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/bin/scan:23:in `<main>'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/bin/ruby_executable_hooks:15:in `eval'
    from /Users/myUser/.rvm/gems/ruby-2.2.0/bin/ruby_executable_hooks:15:in `<main>'

Running tests on more than one device

Hi,
Is it possible to run tests on more than one simulator (eg. iPhone 6s,iPad Air 2) .
In xctest it's possible to have multiple destinations .
Otherwise , is there a way to run scan twice for each config while merging the
report ?

scan is twice slower on building code

As I see - the difference between my xcodebuild arguments and scan generated is:
I run clean test and scan runs clean build test.

I also see duplicates of compiling lines.

Is it building twice?

Environment variable to disable slack for scan

I have the SLACK_URL environment variable set in my Fastfile in order to enable slack notifications in some of the other fastlane tools. However I don't want scan to ever post to slack. Currently, my fix is to set skip_slack: true in every lane that uses scan.

It'd be nicer if we had an environment variable to skip slack (perhaps SCAN_SKIP_SLACK) so that I didn't have to include the skip_slack: true parameter for each call to scan in my Fastfile.

Coverage Reports?

Does scan have a mechanism to generate coverage reports? I know you can enable coverage checking but i'm not sure what else you can do with it.

Specify derived data path

In my use case, I'm wanting to run scan from within fastlane and have the derived data that gets generated used by other fastlane actions. Is this something currently supported? Is it possible to specify the derived data location?

Thanks.

Adding a timeout option

I am running XC UI tests. Often they are stucking because of simulator is not responding. The scan process wait a long time. Is there some way to terminate testing by timeout and generate report as is?
Also, My console output says me nothing about some problem with sim:
[...]testRemoveUnsentItem (60.486 seconds) 2015-12-23 20:20:07.946 xcodebuild[61490:7264664] [MT] IDETestOperationsObserverDebug: (2CDF552D-23BF-4484-87CF-355405801581) Beginning test session 2CDF552D-23BF-4484-87CF-355405801581 with Xcode 7C62b on target <DVTiPhoneSimulator: 0x7fdae6796a40> { SimDevice: SimDevice : iPad 2 (A09BF579-8C13-418D-B035-BAD8A29C0BEE) : state={ Booted } deviceType={ SimDeviceType : com.apple.CoreSimulator.SimDeviceType.iPad-2 } runtime={ SimRuntime : 9.2 (13C70) - com.apple.CoreSimulator.SimRuntime.iOS-9-2 } } (9.2 (13C70))

Simulator is not started

I've got this issue:
2015-10-30 16:56:05.815 xcodebuild[53793:347720] iPhoneSimulator: Timed out waiting 120 seconds for simulator to boot, current state is 1.

I've got it before tunning xcodebuild (xctool didn't have this issue).
It is solved by running the simulatore (instrument -w or ios-sim).

But maybe it can be solved inside scan?

Appreciate you work!

Returning the test result

Hi,
Is there a way to manage the test result directly on Fasfile? For example, I was expecting there was a variable into lane_context, but I can't find it.
This is what I want to do

scan(
    ...
)

if test_result
    testflght(
        ...
    )
end

Tests exucution fails because simulator version is not satisfying minimum Deployment Target

Deployment target of the project is 9.1
scan picks the first simulator with iOS 8.4

+-----------------------+----------------------------------+
|                  Summary for scan 0.2.1                  |
+-----------------------+----------------------------------+
| project               | ./XctoolUITestsSupprot.xcodeproj |
| scheme                | XctoolUITestsSupprot             |
| clean                 | false                            |
| output_directory      | ./test_output                    |
| output_types          | html,junit                       |
| buildlog_path         | ~/Library/Logs/scan              |
| open_report           | false                            |
| skip_slack            | false                            |
| slack_only_on_failure | false                            |
+-----------------------+----------------------------------+

[00:21:09]: set -o pipefail && xcodebuild -scheme 'XctoolUITestsSupprot' -project './XctoolUITestsSupprot.xcodeproj' -destination 'platform=iOS Simulator,id=180B69BE-84D0-4DAE-BB86-E5F94169DD99' build test | tee '/Users/amatosov.ctr/Library/Logs/scan/XctoolUITestsSupprot-XctoolUITestsSupprot.log' | xcpretty 

...
xcodebuild: error: Unable to find a destination matching the provided destination specifier:
{ platform:iOS Simulator, id:180B69BE-84D0-4DAE-BB86-E5F94169DD99 }

Available destinations for the "XctoolUITestsSupprot" scheme:
{ platform:iOS Simulator, id:2A02D462-0D2B-4323-BA38-459C264F5EDC, OS:9.1, name:iPad 2 }
{ platform:iOS Simulator, id:CCE983D9-3184-4FC5-A7C2-DA8CA9CEAC70, OS:9.1, name:iPad Air 2 }
{ platform:iOS Simulator, id:42A954DB-BBD9-4970-8BAC-5FEF9F6B0EC8, OS:9.1, name:iPhone 5 }
{ platform:iOS Simulator, id:A68769AA-6668-45C0-9B79-FBEAB2F5D17E, OS:9.1, name:iPhone 6s }
[00:21:10]: Exit status: 70

instruments -s devices
Known Devices:
iPad 2 (9.1) [2A02D462-0D2B-4323-BA38-459C264F5EDC]
iPad Air 2 (9.1) [CCE983D9-3184-4FC5-A7C2-DA8CA9CEAC70]
iPhone 5 (9.1) [42A954DB-BBD9-4970-8BAC-5FEF9F6B0EC8]
iPhone 6 (8.4) [180B69BE-84D0-4DAE-BB86-E5F94169DD99]
iPhone 6s (9.1) [A68769AA-6668-45C0-9B79-FBEAB2F5D17E]

Reset Content and Settings option

Is there an option to Reset Content and Settings as the corresponding Simulator menu does?
This is extremely helpful for complex tests.

Run tests on an iOS device

Is there a way to run scan and have the tests run on an actual iOS device instead of a simulator?

Scan adds workspace parameter even if you don't set it

I would like to be able to set the target via xcargs without setting workspace since xcodebuild can't have both at the same time. It seems that scan is adding the workspace parameter to xcodebuild automatically...I need this for a static library project that has a normal target and a test target...

More Platforms

It would be cool if scan would support watchOS and tvOS. I've run into an issue using it where it defaults to iOS Simulator when testing a tvOS target instead of tvOS Simulator.

I don't know if this change would need to be done to FastlaneCore but the section that would need to be changed is the following:

https://github.com/fastlane/scan/blob/843c1b74a51bb6405482e73863078e8b9076ac26/lib/scan/detect_values.rb#L62-L65

iPad vs Universal

I was running into an error with scan with a project set to build only for iPad

+------------+------------------+
|    Summary for scan 0.3.2     |
+------------+------------------+
| project    | ./otto.xcodeproj |
| scheme     | otto             |
+------------+------------------+

[11:44:08]: $ set -o pipefail && env NSUnbufferedIO=YES xcodebuild -scheme 'otto' -project './otto.xcodeproj' -destination 'platform=iOS Simulator,id=4F273207-BC6F-416B-91B5-BE3CABB7B547' build test | tee '/Users/jstein/Library/Logs/scan/otto-otto.log' | xcpretty
[11:44:08]: > Loading...
[11:44:08]: > xcodebuild: error: Unable to find a destination matching the provided destination specifier:
[11:44:08]: > { platform:iOS Simulator, id:4F273207-BC6F-416B-91B5-BE3CABB7B547 }
[11:44:08]: > Available destinations for the "otto" scheme:
[11:44:08]: > { platform:iOS Simulator, id:54D0DECF-557D-42A8-8080-B8272224F037, OS:9.2, name:iPad 2 }
[11:44:08]: > { platform:iOS Simulator, id:6ED349D0-EAE5-4717-8866-D53FA60214D9, OS:9.2, name:iPad Air }
[11:44:08]: > { platform:iOS Simulator, id:56CDB115-8D17-4414-BA6E-EA8E3989C93A, OS:9.2, name:iPad Air 2 }
[11:44:08]: > { platform:iOS Simulator, id:4E965AFC-F204-4977-824D-BB5F63924B05, OS:9.2, name:iPad Pro }
[11:44:08]: > { platform:iOS Simulator, id:F09CDF01-C057-4470-B3BF-5A400A6D1898, OS:9.2, name:iPad Retina }
xcodebuild: error: Unable to find a destination matching the provided destination specifier:
{ platform:iOS Simulator, id:4F273207-BC6F-416B-91B5-BE3CABB7B547 }

Available destinations for the "otto" scheme:
{ platform:iOS Simulator, id:54D0DECF-557D-42A8-8080-B8272224F037, OS:9.2, name:iPad 2 }
{ platform:iOS Simulator, id:6ED349D0-EAE5-4717-8866-D53FA60214D9, OS:9.2, name:iPad Air }
{ platform:iOS Simulator, id:56CDB115-8D17-4414-BA6E-EA8E3989C93A, OS:9.2, name:iPad Air 2 }
{ platform:iOS Simulator, id:4E965AFC-F204-4977-824D-BB5F63924B05, OS:9.2, name:iPad Pro }
{ platform:iOS Simulator, id:F09CDF01-C057-4470-B3BF-5A400A6D1898, OS:9.2, name:iPad Retina }
[11:44:09]: Exit status: 70

If i change my Devices setting to Universal everything is peachy.

Is this a bug or I'm just not using the command line correctly?

Could not find action or lane 'scan'

run fastlane run_test

FastFile

  desc "Run Tests"
  lane :run_tests do
    #sh "cd ..;scan"
    scan
  end

stack trace

/Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/lib/fastlane/runner.rb:117:in `try_switch_to_lane': Could not find action or lane 'scan'. Check out the README for more details: https://github.com/KrauseFx/fastlane (RuntimeError)
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/lib/fastlane/fast_file.rb:141:in `rescue in method_missing'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/lib/fastlane/fast_file.rb:136:in `method_missing'
    from Fastfile:38:in `block (2 levels) in parsing_binding'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/lib/fastlane/lane.rb:36:in `call'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/lib/fastlane/lane.rb:36:in `call'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/lib/fastlane/runner.rb:51:in `block in execute'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/lib/fastlane/runner.rb:46:in `chdir'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/lib/fastlane/runner.rb:46:in `execute'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/lib/fastlane/lane_manager.rb:43:in `cruise_lane'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/lib/fastlane/command_line_handler.rb:31:in `handle'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/bin/fastlane:35:in `block (2 levels) in run'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:153:in `run'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/runner.rb:428:in `run_active_command'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/runner.rb:68:in `run!'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/delegates.rb:15:in `run!'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/bin/fastlane:152:in `run'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane-1.33.6/bin/fastlane:158:in `<top (required)>'
    from /usr/local/bin/fastlane:23:in `load'
    from /usr/local/bin/fastlane:23:in `<main>'

Forced slack_url parameter

Issue description

scan 0.1.0 asks for slack_url when slack should be skipped (--skip_slack):

$ scan --skip_slack -s Example tests
[20:59:42]: xcrun xcodebuild -list -workspace './Example.xcworkspace'
[20:59:43]: xcrun xcodebuild -showBuildSettings -workspace './Example.xcworkspace' -scheme 'Example'
[20:59:44]: To not be asked about this value, you can specify it using 'slack_url'
Create an Incoming WebHook for your Slack group to post results there:

Expected behavior:

scan turns off slack notifications for --skip_slack and does not ask for slack_url.

System info

$ scan --version
scan 0.1.0
$ fastlane --version
fastlane 1.33.6

Thanks for scan!

Seeing "Failed to launch IBCocoaTouchImageCatalogTool via CoreSimulator spawn"

I'm seeing this issue intermittently: "Failed to launch IBCocoaTouchImageCatalogTool via CoreSimulator spawn"

From initial searches, it seems to be an internal xcode issue and others have resolved the issue by restarting the machine or Xcode. I haven't had success with restarting / clearing derived data however.

Is there something else that can be done here to help mitigate this issue? I'm spawning a new simulator for each build to avoid issues with migrations and am using scan.

Thanks! This tool is great.

Travis iOS build truncated to "Loading…"

Scan version: 0.1.0
Xcode version: 7.1 (CLT installed — both remote and local)
Scan parameters: --clean --skip_html_open --slack_only_on_failure --slack_url <#REDACTED#>

Report description:

I have a UI-less iOS and Mac framework CI'ed on Travis that I'm setting Scan up with.

The relevant section of .travis.yml:

script:
- scan -s "Deferred"
- scan -s "MobileDeferred"

Builds on Travis run and pass as expected. However, the log view for the iOS build stops with the first statement in typical log output, "Loading…".

Expected behavior:

The full log output, with Travis-formatted section tagging, is available on the build's page.

Encountered behavior:

There's only a single statement left in the log once the iOS build starts. Example here.

The full download log appears to have the iOS log in it.

Running the scan commands manually locally have no such issue.

Notes

While I considered the issue to be just as valid to report against supermarin/xcpretty or travis-ci/travis-ci, our previous setup uses xcpretty plain with kattrali/xcpretty-travis-formatter and has no such issue.

Continue after tests fail, in order to still generate coverage reports?

Is it possible to have a lane call a private lane, in this case a lane that uses scan, in order to continue to do actions afterwards, such as generating coverage reports based on the test-reports generated by scan, even if there is one or more failing unit tests? Right now everything fails/quits once scan detects one or more failed unit tests..

Support enableCodeCoverage parameter

In our tests we are generating code coverage, but apparently xcodebuild ignores the setting in schema. Scan should look in the schema and add parameter enableCodeCoverage to build, if required. Otherwise at least another parameter should be added to scan to enable code coverage manually.

http://viteinfinite.com/2015/07/leveraging-swift-code-coverage-with-xcode-7/

Scan doesn't seem to see my Scanfile

I have the following Scanfile (originally generated by scan init):

workspace "Example/Example.xcworkspace"
device "iPhone 6"
scheme "Example"
clean true

$ scan --version
scan 0.3.0

When I try and run scan it prompts me to specify a project name:

$ scan
Couldn't automatically detect the project file, please provide a path:

Cannot run tests with scan (error 65)

Scanfile:

scheme '[REDACTED]'
skip_slack true
slack_url 'https://whatever.com'  <----- See #1 issue on scan
skip_html_open true
clean true

Output:

** TEST FAILED **
[17:11:58]: Exit status: 65
/Library/Ruby/Gems/2.0.0/gems/scan-0.1.0/lib/scan/error_handler.rb:32:in `handle_build_error': Error building/testing the application - see the log above (RuntimeError)
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.1.0/lib/scan/runner.rb:30:in `block in test_app'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane_core-0.25.2/lib/fastlane_core/command_executor.rb:62:in `call'
    from /Library/Ruby/Gems/2.0.0/gems/fastlane_core-0.25.2/lib/fastlane_core/command_executor.rb:62:in `execute'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.1.0/lib/scan/runner.rb:23:in `test_app'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.1.0/lib/scan/runner.rb:9:in `run'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.1.0/lib/scan/manager.rb:10:in `work'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.1.0/lib/scan/commands_generator.rb:41:in `block (2 levels) in run'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:178:in `call'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/command.rb:153:in `run'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/runner.rb:428:in `run_active_command'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/runner.rb:68:in `run!'
    from /Library/Ruby/Gems/2.0.0/gems/commander-4.3.5/lib/commander/delegates.rb:15:in `run!'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.1.0/lib/scan/commands_generator.rb:60:in `run'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.1.0/lib/scan/commands_generator.rb:14:in `start'
    from /Library/Ruby/Gems/2.0.0/gems/scan-0.1.0/bin/scan:6:in `<top (required)>'
    from /usr/bin/scan:23:in `load'
    from /usr/bin/scan:23:in `<main>'

FWIW:
I saw a red line in the console a few seconds before I got this stack trace (that weirdly enough is not there anymore) about "waiting 120 seconds for the simulator to boot"

FWIW/2:
Running tests with CMD+U from Xcode works fine

Possibly related:
Bitrise issue

P.s.
Thanks for scan, I was really waiting for something like this!

Run only the unit tests (or only the UI tests)

In my deployment pipeline, in the commit stage, I would like to run only the unit tests in order to have a commit stage lasting maximum 5 to 10 minutes.
Then, if it succeeds, I would like to run only the UI Tests, to know if the acceptance tests pass.
I could also imagine a mix of both, where the unit tests and 1 or 2 UI Tests (as smoke tests) should run in a stage, and then some others.

Is it doable with scan? How do you suggest to do it?

Thanks for your answer, and thanks for your work on fastlane, it is awesome! 👍

output_style parameter support

It would be nice to have output_style: :basic as xcodebuild action has.

Thank you!

Add branch name to slack notification

It would be nice if the notification in slack (optionally) shows the branch name that the tests were run with.

iPhoneSimulator: Could not launch simulator: -600

I have some integration tests running on a jenkins every hour using fastlane 1.37.0, Xcode 7.1, scan 0.2.1. About half of the times it fails like this:

2015-11-06 08:52:25.449 xcodebuild[69510:4284190]  iPhoneSimulator: Could not launch simulator: -600

Testing failed:
Test target kWalletTestsIntegrationKIWI encountered an error (The operation couldn't be completed. (OSStatus error -600.) If you believe this error represents a bug, please attach the log file at /var/folders/z7/s666wrgx5cvgwr7f52_zpcw40000gs/T/com.apple.dt.XCTest-status/Session-2015-11-06_08:52:23-PapSP9.log)
** TEST FAILED **

where the log file looks like this:

08:52:23.036 xcodebuild[69510:4283923] Beginning test session B0FA6299-AC56-4AB2-96FF-67B05CFF2A9E with Xcode 7B91b on target <DVTiPhoneSimulator: 0x7fe5abcd7ea0> {
        SimDevice: SimDevice : iPhone 5 (00CE1587-C01E-43B9-860D-0B1AA306311E) : state={ Shutdown } deviceType={ SimDeviceType : com.apple.CoreSimulator.SimDeviceType.iPhone-5 } runtime={ SimRuntime : 9.1 (13B137) - com.apple.CoreSimulator.SimRuntime.iOS-9-1 }
} (9.1 (13B137))
08:52:23.036 xcodebuild[69510:4283923]  /Applications/Xcode.app/Contents/Developer/usr/bin/xcodebuild
-workspace
./kWallet.xcworkspace
-scheme
MyScheme
-destination
platform=iOS Simulator,id=00CE1587-C01E-43B9-860D-0B1AA306311E
build
test
08:52:23.036 xcodebuild[69510:4283923] Launching with Xcode.IDEFoundation.Launcher.PosixSpawn
08:52:23.036 xcodebuild[69510:4283923] Initializing test infrastructure.
08:52:25.407 xcodebuild[69510:4284189] Launch session started, setting a disallow-finish-token on the run operation.
08:52:25.441 xcodebuild[69510:4283934] Adding console adaptor <IDEConsoleAdaptor: 0x7fe5ad0620a0 'target'> for test session B0FA6299-AC56-4AB2-96FF-67B05CFF2A9E.
08:52:25.453 xcodebuild[69510:4284190] Test operation failure: The operation couldn’t be completed. (OSStatus error -600.)
08:52:25.453 xcodebuild[69510:4284190] _finishWithError:Error Domain=IDETestOperationsObserverErrorDomain Code=3 "The operation couldn’t be completed. (OSStatus error -600.)" UserInfo={NSLocalizedDescription=The operation couldn’t be completed. (OSStatus error -600.)} didCancel: 1

Scan picks the wrong project name for Slack message

I am using xcworkspace for my projects and for some of them scan picks the wrong project name to be posted on Slack:

Pods Tests:
Build Errors: 0
Test Failures: x
Successful Tests: x

Is there a way to specify slack_project_name?

Scan is reporting successful tests when they fail with exit 65 (in this case an uncaught exception)

I just noticed that scan is reporting that my tests pass even though one of them failed. The failing test is raising an exception that is not being caught, this is the weird scan output:

Failing tests:
-[TermsOfUseSpec testLogoutFlow]
** TEST FAILED **
[15:51:11]: Exit status: 65
+--------------------+-------+
|        Test Results        |
+--------------------+-------+
| Number of tests    | 49    |
| Number of failures | 0     |
+--------------------+-------+

Total number of tests if 50. xcodebuild is exiting with 65 and scan's exit code is 0.

When I run the same set of tests from Xcode or xcodebuild it fails as expected. Let me know what other information could help track this down. Meanwhile I'm trying to create a sample project that reproduces this problem.

slack hook not work on "slack_url" and "slack_channel"

hi,
I use script like

scan --slack_url https://hooks.slack.com/services/mychannelxxx

and

scan --slack_channel mychannelxxx

then output
/usr/local/lib/ruby/gems/2.3.0/gems/fastlane_core-0.32.0/lib/fastlane_core/configuration/config_item.rb:56:in `valid?': 'slack_url' value must be a String! Found TrueClass instead. (RuntimeError)

/usr/local/lib/ruby/gems/2.3.0/gems/fastlane_core-0.32.0/lib/fastlane_core/configuration/config_item.rb:56:in `valid?': 'slack_channel' value must be a String! Found TrueClass instead. (RuntimeError)

is that bug??

Device can't be set

I am trying to set the device for scan to use but it always gets sets to iPhone 5s. The command I run is scan --device "iPhone 6s" which gives no error but it doesn't set the simulator to the correct thing. I know that my device name is correct since if I give it a name that doesn't exists the error Couldn't find simulator 'iPhone 6ss' - falling back to default simulator does happen.

Turn logging off, silent mode?

I'd like the option to turn logging off entirely, as well as most of the command line output. I don't need to see what files are building or the other information most of the time, just the warnings or errors.

fastlane-old / scan Goto Github PK

scan's People

Contributors

Stargazers

Watchers

Forkers

scan's Issues

Issue description

Expected behavior:

System info

Thanks for scan!

Report description:

Expected behavior:

Encountered behavior:

Notes

Recommend Projects

Recommend Topics

Recommend Org