Jan Edmund Lazo
e56f62e9a7
vim-patch:8.1.1854: now another timer test is flaky #10791
...
Problem: Now another timer test is flaky.
Solution: Add test to list of flaky tests.
973d5304a4
2019-08-16 22:06:58 +02:00
Jan Edmund Lazo
66528f2475
vim-patch:8.1.1852: timers test is flaky #10788
...
Problem: Timers test is flaky.
Solution: Accept a larger count. Add test to list of flaky tests.
7e6feb9eeb
2019-08-16 10:11:03 +02:00
Daniel Hahler
c285ebfa73
vim-patch:8.1.0456: running test hangs when the input file is being edited ( #10764 )
...
Problem: Running test hangs when the input file is being edited.
Solution: Use a SwapExists autocommand to ignore editing the test script.
d8f27b30d6
2019-08-14 01:56:59 +02:00
Daniel Hahler
db41d02e48
vim-patch:8.1.1842: test listed as flaky should no longer be flaky
...
Problem: Test listed as flaky should no longer be flaky.
Solution: Remove Test_popup_and_window_resize from the list of flaky tests.
(Daniel Hahler, close vim/vim#4807 )
9570aacdb8
2019-08-13 22:15:54 +02:00
Daniel Hahler
3566267e75
vim-patch:8.1.1738: testing lambda with timer is slow ( #10590 )
...
Problem: Testing lambda with timer is slow.
Solution: Do not test timer accuracy, only that it works. (Daniel Hahler,
closes vim/vim#4723 )
9bc4dde45d
2019-07-24 19:47:41 +02:00
Jan Edmund Lazo
71018924fc
vim-patch:8.1.0533: screendump tests can be flaky
...
Problem: Screendump tests can be flaky.
Solution: Add VerifyScreenDump to the pattern of flaky tests.
447f6ce8bd
2019-07-15 23:07:29 -04:00
Jan Edmund Lazo
5b8d378923
vim-patch:8.1.0531: flaky tests often fail with a common error message
...
Problem: Flaky tests often fail with a common error message.
Solution: Add a pattern to match an error message indicating a flaky test.
dbc0d2163a
2019-07-15 23:07:29 -04:00
Daniel Hahler
59b2b1c955
tests: oldtests: mark Test_cursorhold_insert as flaky [ci skip] ( #10264 )
...
Fails often on CI (OSX), e.g.:
```
1 FAILED:
Found errors in Test_cursorhold_insert():
function RunTheTest[37]..Test_cursorhold_insert line 9: Expected 1 but got 0
```
> Compiler: clang Xcode: xcode10.1 C
The test could be adjusted to re-try the timer a few times, but I do not
think it's really worth it currently, and that the test should be marked
as flaky instead.
2019-06-19 01:19:20 +02:00
Jan Edmund Lazo
c6c5754a86
vim-patch:8.1.0044: if a test function exists Vim this may go unnoticed
...
Problem: If a test function exists Vim this may go unnoticed.
Solution: Check for a test funtion quitting Vim. Fix tests that did exit
Vim.
8903676d3d
Restore test_assert.vim to run Test_zz_quit_detected().
2019-06-15 21:48:27 -04:00
Jan Edmund Lazo
1abfeff978
vim-patch:8.1.1545: when the screen is to small there is no message about that
...
Problem: When the screen is to small there is no message about that.
(Daniel Hahler)
Solution: Do not use :cquit. (closes vim/vim#4534 )
45aa07d3c1
2019-06-15 21:48:27 -04:00
Jan Edmund Lazo
005316ae41
vim-patch:8.0.1689: no tests for xxd
...
Problem: No tests for xxd.
Solution: Add a test. (Christian Brabandt)
29f9ed20b4
2019-06-11 22:31:21 -04:00
Daniel Hahler
7810c7ab76
vim-patch:8.1.0529: flaky test sometimes fails in different ways
...
Problem: Flaky test sometimes fails in different ways.
Solution: When the second run gives a different error, try running the test
again, up to five times.
f77af0e613
2019-06-08 13:49:56 +02:00
Jan Edmund Lazo
5395dd6209
vim-patch:8.1.0696: when test_edit fails 'insertmode' may not be reset
...
Problem: When test_edit fails 'insertmode' may not be reset and the next
test may get stuck. (James McCoy)
Solution: Always reset 'insertmode' after executing a test. Avoid that an
InsertCharPre autocommand or a 'complete' function can change the
state. (closes vim/vim#3768 )
8ad16da729
2019-01-06 20:30:38 -05:00
Jan Edmund Lazo
2b7e58cb2c
vim-patch:8.1.0299: misplaced comment
...
Problem: misplaced comment
Solution: Remove comment
142ae736d9
2018-11-17 22:23:30 -05:00
Jan Edmund Lazo
a9ae5bf36b
vim-patch:8.1.0298: window resize test sometimes fails on Mac
...
Problem: Window resize test sometimes fails on Mac.
Solution: Add Test_popup_and_window_resize() to flaky tests.
46fad2ef0b
2018-11-17 22:21:25 -05:00
Justin M. Keyes
6476d081be
test/old: stub CanRunVimInTerminal()
2018-10-16 00:26:01 +02:00
Jan Edmund Lazo
4ca2cf4b47
vim-patch:8.0.1507: timer test is a bit flaky
...
Problem: Timer test is a bit flaky.
Solution: Add it to the list of flaky tests.
bfbea567d8
2018-08-05 17:55:49 -04:00
Jan Edmund Lazo
28c3679b64
vim-patch:8.0.0805: GUI test fails with gnome2
...
Problem: GUI test fails with gnome2.
Solution: Set $HOME to an existing directory.
d1ee0043c0
2018-07-24 22:31:26 -04:00
lonerover
d0e07c043b
vim-patch:8.0.0489: clipboard and "* register is not tested
...
Problem: Clipboard and "* register is not tested.
Solution: Add a test for Mac and X11. (Kazunobu Kuriyama)
7dd4850698
2018-05-20 10:19:41 +08:00
Jan Edmund Lazo
79a8d905ab
oldtests: newstyle: win: reset shell to cmd.exe
...
Unset $SHELL so that child nvim use cmd.exe as default shell.
Unset $TERM so that child nvim don't segfault with negative exit code.
sh/bash use TERM=cygwin by default if it is unset.
mintty sets TERM to xterm.
2018-04-12 02:18:18 -04:00
KunMing Xie
ce5c2030bf
vim-patch:8.0.0417: test for the clipboard fails sometimes ( #8174 )
...
Problem: Test for the clipboard fails sometimes.
Solution: Add it to the flaky tests.
0fbff646d5
2018-03-25 17:20:59 +02:00
Justin M. Keyes
9e9e4431c1
Merge #8001 from justinmk/vimpatches
2018-02-12 02:59:29 +01:00
Justin M. Keyes
418947fcb3
Merge #7966 'vim-patch:8.0.0470,8.0.0471'
2018-02-12 00:55:56 +01:00
Justin M. Keyes
ef39f854d7
vim-patch:8.0.1302: still too many old style tests
...
Problem: Still too many old style tests.
Solution: Convert a few more tests to new style. (Yegappan Lakshmanan,
closes vim/vim#2326 )
209d3874c1
2018-02-11 23:30:18 +01:00
Justin M. Keyes
22173a64dd
vim-patch:8.0.0479: remote_peek() is not tested
...
Problem: remote_peek() is not tested.
Solution: Add a test.
6caf606b14
2018-02-11 19:03:29 +01:00
Justin M. Keyes
fda2b1e906
vim-patch:8.0.0295: test_viml hangs
...
Problem: test_viml hangs.
Solution: Put resetting 'more' before sourcing the script.
7a073549a3
2018-02-11 19:03:29 +01:00
Justin M. Keyes
7a91177bc9
vim-patch:8.0.0293: some tests have a one or three second wait
...
Problem: Some tests have a one or three second wait.
Solution: Reset the 'showmode' option. Use a test time of one to disable
sleep after an error or warning message.
e5f2a075e3
2018-02-11 19:03:29 +01:00
Justin M. Keyes
840a2bb67d
vim-patch:8.0.1370: channel test for callback is flaky
...
Problem: Channel test for callback is flaky.
Solution: Add the test to thelist of flaky tests.
1eca6f13d6
2018-02-11 19:03:28 +01:00
Justin M. Keyes
bef505c158
vim-patch:8.0.1365: when one channel test fails others fail as well
...
Problem: When one channel test fails others fail as well.
Solution: Stop the job after a failure. Also add a couple of tests to the
list of flaky tests.
24820691e6
2018-02-11 19:03:28 +01:00
Justin M. Keyes
44f275d518
vim-patch:8.0.1329: when a flaky test fails it also often fails the second time
...
Problem: When a flaky test fails it also often fails the second time.
Solution: Sleep a couple of seconds before the second try.
5505860152
2018-02-11 19:03:28 +01:00
Justin M. Keyes
1be0107168
vim-patch:8.0.0480: the remote_peek() test fails on MS-Windows
...
Problem: The remote_peek() test fails on MS-Windows.
Solution: Check for pending messages. Also report errors in the first run if
a flaky test fails twice.
15e737f768
2018-02-11 19:03:28 +01:00
Justin M. Keyes
bcd8541863
vim-patch:7.4.1477
...
Problem: Test_reltime is flaky, it depends on timing.
Solution: When it fails run it a second time.
b5760a1ce5
2018-02-11 19:03:28 +01:00
Justin M. Keyes
8dd63dbe31
vim-patch:8.0.1262: terminal redir test is flaky
...
Problem: Terminal redir test is flaky.
Solution: Add it to the list of flaky tests.
7dd88c5133
2018-02-11 19:03:28 +01:00
Justin M. Keyes
e4952ee006
vim-patch:8.0.1219: terminal test is flaky
...
Problem: Terminal test is flaky.
Solution: Add test function to list of flaky tests.
f204e05ae9
2018-02-11 19:03:28 +01:00
Justin M. Keyes
9b6ed6c71c
vim-patch:8.0.1224: still interference between test functions
...
Problem: Still interference between test functions.
Solution: Clear autocommands. Wipe all buffers. Fix tests that depend on a
specific start context.
cf1ba35fc2
2018-02-11 19:03:27 +01:00
Justin M. Keyes
348193f49c
vim-patch:8.0.1222: test functions interfere with each other
...
Problem: Test functions interfere with each other.
Solution: Cleanup tab pages, windows and buffers. Reset option.
ce11de87e2
2018-02-11 19:03:27 +01:00
Justin M. Keyes
e247dd2535
test/oldtest: runtest.vim: align with upstream
2018-02-11 15:29:16 +01:00
Justin M. Keyes
ce92e784e1
vim-patch:8.0.1186: still quite a few old style tests
...
Problem: Still quite a few old style tests.
Solution: Convert old to new style tests. (Yegappan Lakshmanan)
Avoid ringing the bell while running tests.
4a6fcf8047
2018-02-11 15:27:56 +01:00
Justin M. Keyes
c8356e1151
vim-patch:8.0.0440: not enough test coverage in Insert mode
...
[Nvim note: test_override() omitted]
Problem: Not enough test coverage in Insert mode.
Solution: Add lots of tests. Add test_override(). (Christian Brabandt,
closes vim/vim#1521 )
eb992cb90f
2018-02-11 15:27:55 +01:00
Justin M. Keyes
7229493eb1
test/oldtest: move Nvim setup to testdir/setup.vim
2018-02-09 02:25:03 +01:00
ckelsel
ab35caf9cf
vim-patch:8.0.0471: exit callback test sometimes fails
...
Problem: Exit callback test sometimes fails.
Solution: Add it to the list of flaky tests.
0529b3eb01
2018-02-04 16:10:22 +08:00
KunMing Xie
7a4c9dc1c2
vim-patch:8.0.0295 ( #7671 )
...
Problem: test_viml hangs.
Solution: Put resetting 'more' before sourcing the script.
7a073549a3
2017-12-02 17:14:18 +01:00
KunMing Xie
8eb54c5dec
vim-patch:8.0.0088 ( #7080 )
...
Problem: When a test fails in Setup or Teardown the problem is not reported.
Solution: Add a try/catch. (Hirohito Higashi)
cc28e2d05d
2017-07-27 03:56:25 +02:00
Justin M. Keyes
eb6dd3e42d
ci: Dump $NVIM_LOG_FILE contents
2017-06-07 00:26:21 +02:00
James McCoy
dafc14b969
vim-patch:8.0.0477
...
Problem: The client-server test may hang when failing.
Solution: Set a timer. Add assert_report()
42205551b1
2017-06-06 06:15:16 -04:00
James McCoy
cb8efa4fef
vim-patch:8.0.0360
...
Problem: Sometimes VimL is used, which is confusing.
Solution: Consistently use "Vim script". (Hirohito Higashi)
b544f3c81f
2017-06-06 06:15:16 -04:00
James McCoy
018383096c
oldtests: Fix syntax of s:flaky
2017-06-04 22:09:19 -04:00
Justin M. Keyes
41fd278317
oldtests: Mark Test_lambda_with_timer as flaky
2017-05-23 00:44:21 +02:00
James McCoy
4a08320007
oldtests: Mark test_timer's Test_oneshot as flaky
2017-05-16 15:32:19 -04:00
James McCoy
f3a508b4a3
oldtests: Fix spelling of testname in s:flaky
2017-05-12 17:32:26 -04:00