|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
 User Profile |
Hi Barry,
I have no problem displaying any of the canned MarketScans in the OT Focus List, so I can't understand why none of my custom Marketscans will display as well?
 Attached file : Capture.PNG (144KB - 1649 downloads)
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
Here is another issue that may indicate that there is a sync problem between OT and MS, even with the canned scans. Once OT and MS have been linked up, all symbols are being updated in RT as normal. However, as time goes by, more and more symbols are not updated in the Focus List, and the "No historical Data available" message replaces those charts. Eventually, there are only 3-4 symbols being updated.
The example below is using the 'Volume Spike (5M) scan. Even if I select a sort value of just the top 10 from this list doesn't seem to make a difference here. Most symbols will eventually stop updating.
OT won't shut down properly after I have disconnected MS. Please see attached log file.
Attached file : Capture.PNG (124KB - 1618 downloads)
Attached file : OT.log (38KB - 480 downloads)
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
Of your 3 reported issues, I can only reproduce one...
1. Custom scans not displaying in OT with AutoSync.
I reproduced & reported this, thanks.
2. OT won't shut down properly after closing MS.
I'm able to close MS, then close OT afterwards without a problem. Maybe try again? Perhaps it can only occur if certain things are happening at the same time? Or it's possible it's related to your third issue.
3. New MS symbols added to list do not collect RT data in OT.
I can't reproduce this either. I'm wondering if you're downloading data for more than 500 symbols at the same time. That's the behavior you would get if this is the case. To check, in your system tray on the Windows Taskbar you should have the OmniData Manager running. Open it & see how many symbols it's collecting data for simultaneously. If it stays below 500 you shouldn't have that issue.
Attached file : OD.jpg (14KB - 1604 downloads)
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
I'm having the same issue on both computers. The list count is less than 31 symbols. I even tried removing all custom scan list, but that didn't make a difference either. Something goes wrong internally as the regular OScan list quits updating as well whenever MS is or has been synced up with OT, and subsequently requires a restart (see attached log file). Btw, I noticed that there are some unrecognized symbols reported by the datafeed...
Attached file : Capture.JPG (46KB - 1523 downloads)
Attached file : OT.log (25KB - 480 downloads)
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
Similar problem in VT. I'm able to create a MS group, but the symbols won't sync properly. Just before writing this, it caused VT to crash with a slew of errors, and I had to shut it down using the Task Manager. See attached log.
UPDATE: Managed to get VT-MS working after a couple of restarts and another crash. OT-MS still doesn't update the entire list of 20 symbols...
Attached file : VisualTrader.log (1480KB - 465 downloads)
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
We will have a fix for custom MarketScans not working in OT soon, sometime next week. Thanks for your patience.
|
|
EYEGUY
Posts: 1543
Joined: 12/12/2003
Location: BALDWINSVILLE, NEW YORK
User Profile |
Barry:
Thanks for the update!
Tom Helget
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
The fix is live now. Restart Marketscans to get the update.
|
|
EYEGUY
Posts: 1543
Joined: 12/12/2003
Location: BALDWINSVILLE, NEW YORK
User Profile |
Barry:
So, just to be clear - the problem was with MarketScans and not OT. No new pre-release of OT is necessary - just a restart of MarketScans.
Correct?
And Thanks!
Tom Helget
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
That's correct, Tom.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
There is an issue with the installer on the latest update. It takes me to the InstallShield Wizard window where it asks me whether I want to Modify, Repair or Uninstall. Same behavior on both of my computers.
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
Always click Repair if you see that, unless you are uninstalling then you'd click Remove.
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
Actually hang on. The update isn't downloading, so it's still installing the last update. Should have it fixed shortly.
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
Ok it's there now.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
See below screenshot. The only way you will be able to replicate it is to sync up MS with OT and let it run for a while...(this is a 5M intraday profile)
Attached file : Capture.JPG (367KB - 1425 downloads)
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
John,
If you restart OT or MS, does it start to work again? How long do you have it running before it starts to exhibit that behavior?
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
Yes, it usually starts working again after a restart (or a couple of restarts).
You may have to leave it running for an hour or two...
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
There is one obvious reason as to why there is a "discrepancy". After a fresh restart, the OT Focus List will be identical to that of the MS. However, once trades are being executed, those symbols will remain in the Focus List (at least until they are closed out). From then on, MS will just keep amending the Focus List with new symbols, and only remove symbols that are not in a trade.
However, it doesn't explain why the Data Manager isn't able to update the entire Focus List, as long as the maximum number of simultaneous streaming symbols hasn't been exceeded?
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
A more serious problem related to the above is that I had several trades executed by AT on 5M charts, which had quit updating roughly half way through the trading session today. Some trades were even executed after the chart in question had stopped updating (no signal on the voteline obviously).
I was going to take a few screenshots of it after the close, but OT crashed (again) before I was able to do so. I'm sure glad I'm able to detect these things in a paper account. I just don't trust it for live trading at the moment...
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
With the issue you're having with MarketScans, I would not recommend running it with AutoTrade, at least not until we can resolve it, or the issues you encounter will be compounded.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Fair enough Barry,
I assume you're able to replicate some of the issues that I have encountered?
The OT-MS concept is absolutely brilliant with the strategies I'm currently testing, so I hope all of the Focus List issues can be resolved..!
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
I see the issue, John. The OmniData Manager is not freeing up the symbol count when MS removes stocks from the list. Eventually you will reach the 500 symbol limit & see the issue you're encountering. We'll fix it.
In the meantime, you can reset the symbol count by restarting OT or restarting the OmniData Manager (can right-click it & choose shutdown).
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Great Barry,
Once again, appreciate your hard work..!!
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
John, please try it again & let me know if it still occurs. You can check it easily by viewing the OmniData Manager. Make sure the "# Master Syms" count is reduced when symbols are automatically removed from the Focus List.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
Below snapshot was taken approx 10 minutes after a fresh restart of OT. The initial # Master Syms was 50. It has now dropped to 20.
Attached file : Capture.JPG (319KB - 1258 downloads)
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
That's good & is equivalent to what I'm seeing. Keep in mind that it will count symbols in your My Symbols list as well as any stocks you have in your alerts or open positions in the portfolio - which is probably why it's counting 9 more symbols than showing in that list.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
Yes, I realize that symbols in open positions etc. can't be flushed from the FL.
So far today, the scan count has been rather low (mostly less than 10). Hence, no issues with symbols not updating etc. But how about when the scan count jumps up to 40-50 symbols again?
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
There shouldn't be a problem unless it gets above 500. And if the count reduces as symbols are removed from the list you shouldn't have that issue again.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
May I ask if you guys made any alterations or modifications at your end?
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
No changes for this specific issue, but there were changes for other things. I had reproduced it last week & now I don't see the issue anymore.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
HI Barry,
The scan count is higher today, and 90 minutes into the trading session I'm seeing the same behavior that I previously reported.
The starting population (US Stocks with Weekly Options) is less than the 500 symbol limit you're referring to...
Attached file : Capture.JPG (375KB - 849 downloads)
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
What does the "# Master Syms" count show in the OmniData manager?
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
HI Barry,
# Master Syms = 50 (at the time)
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
Ok, that indicates to not be the issue then. Do you have any errors? If you close OT, does it ask you to submit an error? Please submit if it asks.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry
When I restarted OT about 30-40 minutes ago, it didn't ask me to submit any errors. However, it seems like the Log file does contain some errors etc., though.
See attached.
Attached file : OT.log (21KB - 394 downloads)
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
Once again I had to restart OT just after 90 minute into the trading session. This time it did want me to submit an error report (see attached). Seems like there's a lot going on here..?
Attached file : OT.log (54KB - 417 downloads)
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
I've seen that error as well. Though I ran it all day yesterday & didn't see an issue.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
I have noticed if I run OT/VT/MS simultaneously on both of my computers in RT, it causes all kinds of problems and usually one of them will end up crashing. Not sure if it's related to what's being discussed here but it might? I do realize that the symbol count limit in MS and Data Manager will be reached rather quickly in this scenario.
Attached file : Capture.JPG (459KB - 745 downloads)
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
Exchanges won't allow an RT data feed to run on more than one device at the same time, so that doesn't work. That case isn't handled properly in OT & VT due (reported bug) which is why it sometimes crashes like that. They should be ok if ran on the same machine though.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
When can we expect a bug fix..?
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
It's been a month now since this was reported. When can we expect a bug fix?
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
It's difficult to fix something when it isn't able to be reproduced. Last time I tried I let it run an entire day & it had no issues. I had a developer running it as well with no issues. After reviewing this thread again, I want you to try something. In MarketScans, open the Settings to the Charts tab. Set the Provider to "None" & save it & restart MS. Then see if the issue continues or not.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
This morning, I tried with Provider set to "None" and MS synced up with VT. After one hour into the trading session, I noticed that several symbols in the Opportunity List quit updating. I then went to shut down VT at which time it crashed (see attached log).
I have submitted quite a few of these error logs recently, so something is clearly not functioning properly.
EDIT: I switched to OT for further testing. I noticed in the OT and VT logs that there are several entries referring to invalid dates?:
OT
10/11/17 10:01:45 AM tmrAutoTrade_Tick: goProfile.DataLastBar returned invalid date =>1/01/00 12:00:00 AM
VT
10/11/17 8:54:33 AM moTradeThrottleTimer_Tick: goWorld.DataLastBar returned invalid date =>1/01/00 12:00:00 AM
Attached file : VisualTrader.log (39KB - 377 downloads)
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
So the attached screenshot was taken roughly 1 hour after syncing MS up with OT in a 5M time frame, using a canned scan. Only 3 of the symbols are still being updated. I have also attached a copy of the log file, which was saved at the time of the screenshot.
I didn't see any improvement by setting Provider to 'None', so I switched it back to 'MarketScans'. If 'None' is selected, it seems like the connection with OT gets interrupted, and I also noticed that the MS Auto-Preview window doesn't get updated either...
Attached file : Capture.JPG (305KB - 693 downloads)
Attached file : OT.log (67KB - 418 downloads)
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
I was able to reproduce it today, John. If you chart symbols, the stocks are supposed to remain in the Focus List even after they leave the scan. That is functioning, but that is causing the no current record errors. And those errors seem to be causing the symbols to not load data.
Please restart OT & try it again without charting any symbols & let me know if the issue returns.
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
Without charting I reproduced a different error as well, which also caused the symbols to stop loading data. So it seems there are 2 cases that can cause it.
From what I can tell, when the error form appears, for any error, that form requires you to click it away first. While the error form is open it seems to cause data not to load.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
I tighter integration between MS and OT/VT is obviously necessary.
1. Charted symbols - Not in Trade - need to be purged when they leave the scan. It shouldn't be left to the end user to remember to close them out beforehand (the only exception to this is if the user is actually in the process of entering a manual trade on a specific chart).
2. Charted symbols - In Trade - need to be taken into account when MS scan updates the FL (or MS Group in VT). In other words, if the # Master Syms (Data Manager) is 50 and the number of open trades is 10, then the FS shouldn't allow more than 40 symbols to go through from the MS scan.
As far as I'm concerned, once the "Sync MarketScans List in Real-Time profiles" has been checked, the user is implicitly accepting and agreeing to the above.
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
Symbols from MarketScans lists that are charted, in open positions, or have been selected in the Good Opportunity column will remain in the OT Focus List. That's intended.
The errors & data not coming through we need to fix. The good news is I am able to reproduce it now. I think one piece of the puzzle may be the strategy you're using. I'm not 100% sure yet, but it may be part of the issue, with the strategy trying to get data for SPY & it not being in the Focus List. I haven't seen the issue yet since I disabled that SS Heikin Ashi 2 strategy. Either way though it needs to be fixed. Development is currently tied up in projects right now, but once available I'll make sure it gets looked at.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Thanks Barry..!
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
This bug was reported back in October. When can we expect a fix?
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
I have decided to discontinue my subscription to Marketscans until the bugs have been rectified. I will obviously reconsider once it's fully integrated with the OT Focus List.
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
I understand, John, & will let you know when the issue is resolved.
|
|
John J
Posts: 272
Joined: 8/3/2010
Location: Leduc, AB
User Profile |
Hi Barry,
Time to bump this thread again.
Were the issues reported here ever rectified..??
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
Not yet, but I have more information. The issue is not related to Marketscans at all. It occurs when you're using a heikin-ashi timeframe in a Realtime profile & you remove symbols from your list (which MS tends to do a lot).
|
|
Jim Dean
Posts: 3022
Joined: 9/21/2006
Location: L'ville, GA
User Profile |
This MIGHT help. I had an issue recently that has never occurred before. I was using OScan EOD with a custom Scan, and after the tech formula completed, with results-count showing up on the right, and a list of symbols appearing on the left, OT was FROZEN ... had to use TaskMgr to kill. I restarted OT and did the test a few times with diff formulae, with the same result.
(Actually, KeithP in SA alerted me to this ...)
I called N, and Scott suggested two steps (the second would have been to reload OData - I didn't have to do this ... here is the text of his email to me. Deleting those two files SOLVED the problem. Of the two, the SymDataEOD.otd file was ~1728kB ... the SymData.otd file was only 178kB (or thereabouts).
Redoing the tests after deleting those files seemed to work fine.
============
With OT/VT closed, right click on your OT/VT desktop icon and click on Open File Location.
Next, locate and open the Database folder and search towards the bottom of the list for SymData.otd delete this file. (This is a Microsoft Access file which can not exceed 2gigs in size. While you’re in this folder, check to see if there is a SymDataeod.otd (This is only used if you are doing iEOD charts) if so, delete this as well.
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
Thanks Jim, but no, John's issue is that over time the stocks from Marketscans, integrated in OT & using a heikin ashi timeframe, stop collecting data. I'm pretty confident we'll have a fix for it soon.
|
|
Barry Cohen
Posts: 6338
Joined: 1/19/2004
User Profile |
John, this issue is corrected & will be in the next PR.
|